A long time ago I posted a poll to see what people think about the issue of peer review. Now seems a good time to circulate it again.
In previous posts (e.g. this one) I had advanced the view that, at least in the subject I work in (astrophysics), while in its usual form peer review does achieve some degree of quality control, it is by no means perfect. Some good papers get rejected and some poor papers get accepted. Moreover, the refereeing is usually done for free by members of the academic community while journal publishers use peer review as a justification for levying publication charges in that it provides added value to the publication process – a view I disputed here.
Any system operated by humans is bound to be flawed to some extent, but the question is whether there might be a way to improve the system so that it is fairer and more transparent.
I suggested that it could be replaced by a kind of crowd-sourcing, in which papers are put on an open-access archive or repository of some sort, and can then be commented upon by the community and from which they can be cited by other researchers. This would, if you like, be a sort of “arXiv plus” – good papers would attract attention and poor ones would disappear.
We did consider having open peer review of the sort mentioned above for the Open Journal of Astrophysics but this option was not available for the no-frills off-the-shelf Scholastica platform we went for so we now operate a version of the traditional peer review system. This achieves some level of gate-keeping but also (and much more importantly, in my view) makes constructive criticism to allow authors to improve their papers. We also discussed publishing referee reports alongside the papers, but that is also beyond the scope of our current system (and would of course require the consent of referees).
I have no idea really how strongly others rate the current system of peer review. The following poll is not very scientific, but ‘ve tried to include a reasonably representative range of views from “everything’s OK – let’s keep the current system” to the radical suggestion I make above.
Follow @telescoper







