## Monday, March 08, 2010

### Who pays for submissions ?

Writing a paper takes a tremendous amount of time. So, one of the frequent complaints that authors  make is when PC members submit half-baked, clearly below-threshold reviews on a paper just to get the resume bullet and claim to have done their reviewing duties. Personally, I feel intense anger when receiving  crappy reviews that come with not the slightest bit of insight, and then am expected to rebut them or accept them. Not to mention the long-term psychological damage incurred by having papers rejected one after another.

The problem is that reviewing a paper for a conference is free: all it takes is a few clicks of the mouse to upload your PDF file. (Of course, I'm not accounting for the cost of doing the research  (ha!) and actually reviewing the paper.)

Let's estimate the costs associated with doing research and submitting papers to conferences. I spend many months working, writing and submitting papers to conferences. A highly competitive conference will assign three reviewers to my paper, and with a lot of luck one of them might even tangentially be aware of my research area. After I make up a bunch of numbers, the cost of rejection of my paper amounts to over 3 gazillion dollars, none of which I can recoup. It's clear that conferences, which only survive if people submit, should be paying me to submit !

Of course, imposing this kind of a fee would no doubt drastically reduce the number of papers that are submitted. But this seems like a good thing: it would probably reduce the number of conferences, and remove the fiction that conferences actually do "quality control", leaving them with their original purpose of networking and creating a sense of community. Conferences could generate revenue by charging reviewers for the opportunity to preview the new works being submitted: this  would potentially also improve the quality of the reviews as well.  Although the financial incentive is not that great, getting paid should encourage TPC members to take the process more seriously.

The only downside I can see is people who submit a ton of papers everywhere and become "professional paper writers", but TPC chairs would clearly have to balance this against the research credentials of the people submitting papers. Note that many journals impose author fees for publication of the paper, so this provides a nice offset against that cost.

It just seems crazy to me that the research community provides this free paper previewing service for committees with no negative ramifications for writing totally bogus reviews.

Disclaimers for the sarcasm-challenged:
• Yes, I am obviously aware of Matt Welsh's post on this topic
• Yes, this is a total ripoff/parody of his post
• Yes in fact, I disagree with his point.

1. LOL!

Actually, there were some very interesting comments to that post.

What if only the people who had accepted papers paid the 500$? Does not solve Matt's problem of bad papers being submitted, but at least you get the money. I would not mind paying$500 if my paper got accepted.

As to your idea (taking it seriously for a moment), I don't think people value having a 3 month head start to such a significant extent. Besides reviewing is hard work. And the quality of reviews would be even worse than now. OK, I'll stop there ;-)

2. Great parody, I did enjoy the part on crappy reviews. You should mention when reviewers do not do the work by themselves, but rather send the review to their slaves ... sorry students.

3. This comment has been removed by the author.

4. Nice one - point well taken. The problem runs both ways. Though, I don't feel that authors are entitled to get good reviews back on a paper regardless of what they submit! In some sense our community has led authors to feel that sense of entitlement. I think it is misplaced.

Cheers!
Matt

5. What's the point of having competitive conferences? Conferences should be a meeting place. The reviewing process should be saved for the journals where it can be done properly. That would save all of us a lot of work.

The conferences I find the most interesting to attend are EuroCG and CCCG - both non-competitive conferences.

6. Suresh --

I think you and Matt can, in some sense, both be right. In networking, there's a tradition of writing quite substantive reviews, and there are, in my experience, a much larger fraction of junk submissions than in theory conferences. In theory, there's a tradition of minimal feedback on reviews, and a smaller fraction of true junk.

So perhaps it's just that the different fields would respond differently to Matt's proposal.