Hacker News new | ask | show | jobs
by thejoneser 890 days ago
What is the alternative? Channeling Chuchill, peer review is the worst form of journal review except for all those other forms that have been tried from time to time.

As an associate editor and frequent reviewer, I can say with confidence that peer review filters out at least 90% of the garbage that journals receive as submissions. It also provides useful feedback to researchers who cannot otherwise get it. People submit papers knowing they will get rejected because they want to read the referee reports.

In my field, academics simply do not trust a result until it has been replicated and scrutinized by other researchers. If that doesn't happen, it's usually because the result was not interesting enough for anyone to care. If the scrutiny reveals problems, that undermines the credibility of the authors, which is ultimately more important than whether they get the pub.

A final comment: Peer-reviewed journals differ dramatically in their quality. If you don't know what the good journals are, you should expect that your reading will include a bunch of crap that no serious person in the field would pay attention to. Why these crap journals even exist is a mystery to me.

1 comments

Re 'Why these crap journals even exist is a mystery to me.' Don't journals make money by charging academics to read the whole paper?
And by charging the authors to publish the paper in the first place. Although I think a lot of the money both ways comes from universities and other organisations that pay for publication costs and have deals with publishers.

Thank god for CS's culture of pre-prints on arXiv.

Yes, that's got to be part of the explanation. What's not clear to me is why anyone gets professional credit (e.g., tenure) for publishing in a journal that is obviously bad.
The answer to your question is just part of the whole sad story...

Promotion committees (hopefully!) know which journals or publications are low quality. If they are unfamiliar, they generally don't have time (or inclination) to verify the paper(s) or publication itself. Especially true when it's a slightly different sub-field than their own. So it often comes down to a simple count of pubs. That's usually all the credit they need!