Bad Research As Spam

Jon Katz and Matt Welsh have both written recently about the problems of dealing with crap papers, mainly the pain of having to review them. In an unrelated event, I got into a discussion with some colleagues about the problems of "crap research', and ended up formulating a theory: viz,

bad research is like spam email

in the sense that

1. There seems to be no way to stop it, and many economic incentives to continue it
2. You can't stop it by diktat
3. The only way to deal with it appears to be effective filtering. Like spam, bad research has less of an effect when it gains no attention. 

There are other similarities:

1. we can block spam by filtering certain domains. We also tend to ignore certain kinds of conferences
2. we can block spam by blocking certain email addresses. We also might ignore certain researchers, or at least downweight their work after a series of bad experiences. 
3. More explicit spam blocking policies create a false-negative problem. False-negatives are also a big problem in research.

But this analogy also suggests that we shouldn't be designing strategies to eliminate bad research. We should be designing better methods to focus attention on good research, via better filtering and highlighting mechanisms (social, authoritative or otherwise). 

Personally, I think bad research is less of a problem than lots of cargo-cult research, where it looks a lot like good research is being done, but when you look closely, you realize that nothing of value has been added to the universe. Sadly, a lot of funded research is also like this. 

PS: False negatives are a highly underrated problem in research. I think we vastly overestimate our ability to judge what kinds of research will have lasting value and what potential impact a paper can have. So it's important to err on the side of being more generous to papers, rather than less.