[jules]

What exactly are those costs? Reviewers work for free. The only other thing that's needed is a web application and some hosting. These costs are negligible compared to the tax that closed journals are imposing on the scientific world.

[incremental]

I don't really know the details. But consider what open access journals charge per article: http://www.plos.org/journals/pubfees.php

This is not cheap, and I'm very glad I didn't need to cover this back when I was publishing papers.

If anyone knows a good article on the detailed economics I'd love to see it.

[alttag]

At a premier journal in my field, a "managing editor" is paid for the 25+ hours/wk of work assigning submissions out to the SEs/AEs (based on area of focus), and—more importantly—following up with them on their progress. As I understand, he's also responsible for managing itineraries and speaking engagements for the editor-in-chief, who travels regularly evangelizing (and getting feedback on) the top journal in our field.

We have a couple of EICs for major journals at our school, and I suspect (but do not know for certain) that the journal subsidizes their conference attendance too, so that the journal's senior editorial staff can meet in person at least annually.

My point is: don't constrain your cost focus to just distribution. There's more to running any organization than initially meets the eye.

[jules]

Is all of that necessary? Would a model like the following work:

Have a web site where scientists can submit papers. Other scientists can then review the papers. The reviews are publicly (though optionally anonymously) published along with the papers, and the authors of the paper can submit revised versions of the paper.

[CJefferson]

No.

The website would get far too many terrible papers.

Many papers would get no reviews.

Many reviews would be terrible, and done by non-trustworthy people.

The problem with the system you are suggesting is that it feels a lot like wikipedia, and who "wins" on wikipedia has little to do quality, and a lot to do with who is willing to spend the most time editing / wiki-lawyering.

[MikeTaylor]

Sadly, the evidence so far strongly suggests that you're right, and this idealistic approach won't work. That evidence is from PLoS ONE (which remember is the main example of how many innovations do work). They have had the ability for people to comment on and evaluate their papers for a couple of years now, and it's hardly ever used.

[jules]

So can we get the incentives so that scientists do review in such a system?

[jedbrown]

The EGU journals work this way. Official reviewers are assigned, but third parties can comment. An example submission

http://www.the-cryosphere-discuss.net/5/1749/2011/tcd-5-1749...

[alttag]

A hybrid model with both assigned reviewers and public comment is being tried by a regional journal (Southern Association for Information Systems): http://knol.google.com/k/craig-vanslyke/jsais-review-process...

[greeneggs]

This would not work. Reviewers would not feel comfortable being completely honest if they knew their reviews would be published publicly. In any case, there should be no need for the reviews to be public.

[MikeTaylor]

Reviewers should be prepared to stand by their reviews. If they're not prepated for it to be known that they said something in a review, then they should not say that thing. Anonymity and secrecy in reviewing doesn't help the field.

[zbyszek]

Why should the reviewers feel unconfortable? In the current system, reviews are made available to the paper writers, and that doesn't seem to inhibit the reviewers, despite the fact that one often has a good idea of who the reviewers are, especially in the more niche fields of science.

[lutorm]

Even today reviewers run the risk of having their reviews made public, since nothing prevents the author from disseminating it. They are however normally anonymous.