Anxious not to let the momentum dissipate about the discussion of scientific publishing, I thought I’d try a quick poll to see what people think about the issue of peer review. In my earlier posts I’ve advanced the view that, at least in the subject I work in (astrophysics), peer review achieves very little. Given that it is also extremely expensive when done by traditional journals, I think it could be replaced by a kind of crowd-sourcing, in which papers are put on an open-access archive or repository of some sort, and can then be commented upon by the community and from where they can be cited by other researchers. If you like, a sort of “arXiv plus”. Good papers will attract attention, poor ones will disappear. Such a system also has the advantage of guaranteeing open public access to research papers (although not necessarily to submission, which would have to be restricted to registered users only).
However, this is all just my view and I have no idea really how strongly others rate the current system of peer review. The following poll is not very scientific, but ‘ve tried to include a reasonably representative range of views from “everything’s OK – let’s keep the current system” to the radical suggestion I make above.
Of course, if you have other views about peer review or academic publishing generally, please feel free to post them through the comments box.
I’m very pressed for time this week so I thought I’d cheat by resurrecting and updating an old post from way back when I had just started blogging, about three years ago. I thought of doing this because I just came across a Youtube clip of the late great Alfred Hitchcock, which you’ll now find in the post. I’ve also made a couple of minor editorial changes, but basically it’s a recycled piece and you should therefore read it for environmental reasons.
–0–
Unpick the plot of any thriller or suspense movie and the chances are that somewhere within it you will find lurking at least one MacGuffin. This might be a tangible thing, such the eponymous sculpture of a Falcon in the archetypal noir classic The Maltese Falcon or it may be rather nebulous, like the “top secret plans” in Hitchcock’s The Thirty Nine Steps. Its true character may be never fully revealed, such as in the case of the glowing contents of the briefcase in Pulp Fiction, which is a classic example of the “undisclosed object” type of MacGuffin. Or it may be scarily obvious, like a doomsday machine or some other “Big Dumb Object” you might find in a science fiction thriller. It may even not be a real thing at all. It could be an event or an idea or even something that doesn’t exist in any real sense at all, such the fictitious decoy character George Kaplan in North by Northwest.
Whatever it is or is not, the MacGuffin is responsible for kick-starting the plot. It makes the characters embark upon the course of action they take as the tale begins to unfold. This plot device was particularly beloved by Alfred Hitchcock (who was responsible for introducing the word to the film industry). Hitchcock was however always at pains to ensure that the MacGuffin never played as an important a role in the mind of the audience as it did for the protagonists. As the plot twists and turns – as it usually does in such films – and its own momentum carries the story forward, the importance of the MacGuffin tends to fade, and by the end we have often forgotten all about it. Hitchcock’s movies rarely bother to explain their MacGuffin(s) in much detail and they often confuse the issue even further by mixing genuine MacGuffins with mere red herrings.
Here is the man himself explaining the concept at the beginning of this clip. (The rest of the interview is also enjoyable, convering such diverse topics as laxatives, ravens and nudity..)
North by North West is a fine example of a multi-MacGuffin movie. The centre of its convoluted plot involves espionage and the smuggling of what is only cursorily described as “government secrets”. But although this is behind the whole story, it is the emerging romance, accidental betrayal and frantic rescue involving the lead characters played by Cary Grant and Eve Marie Saint that really engages the characters and the audience as the film gathers pace. The MacGuffin is a trigger, but it soon fades into the background as other factors take over.
There’s nothing particular new about the idea of a MacGuffin. I suppose the ultimate example is the Holy Grail in the tales of King Arthur and the Knights of the Round Table and, much more recently, the Da Vinci Code. The original Grail itself is basically a peg on which to hang a series of otherwise disconnected stories. It is barely mentioned once each individual story has started and, of course, is never found.
Physicists are fond of describing things as “The Holy Grail” of their subject, such as the Higgs Boson or gravitational waves. This always seemed to me to be an unfortunate description, as the Grail quest consumed a huge amount of resources in a predictably fruitless hunt for something whose significance could be seen to be dubious at the outset.The MacGuffin Effect nevertheless continues to reveal itself in science, although in different forms to those found in Hollywood.
The Large Hadron Collider (LHC), switched on to the accompaniment of great fanfares a few years ago, provides a nice example of how the MacGuffin actually works pretty much backwards in the world of Big Science. To the public, the LHC was built to detect the Higgs Boson, a hypothetical beastie introduced to account for the masses of other particles. If it exists the high-energy collisions engineered by LHC should reveal its presence. The Higgs Boson is thus the LHC’s own MacGuffin. Or at least it would be if it were really the reason why LHC has been built. In fact there are dozens of experiments at CERN and many of them have very different motivations from the quest for the Higgs, such as evidence for supersymmetry.
Particle physicists are not daft, however, and they have realised that the public and, perhaps more importantly, government funding agencies need to have a really big hook to hang such a big bag of money on. Hence the emergence of the Higgs as a sort of master MacGuffin, concocted specifically for public consumption, which is much more effective politically than the plethora of mini-MacGuffins which, to be honest, would be a fairer description of the real state of affairs.
Even this MacGuffin has its problems, though. The Higgs mechanism is notoriously difficult to explain to the public, so some have resorted to a less specific but more misleading version: “The Big Bang”. As I’ve already griped, the LHC will never generate energies anything like the Big Bang did, so I don’t have any time for the language of the “Big Bang Machine”, even as a MacGuffin.
While particle physicists might pretend to be doing cosmology, we astrophysicists have to contend with MacGuffins of our own. One of the most important discoveries we have made about the Universe in the last decade is that its expansion seems to be accelerating. Since gravity usually tugs on things and makes them slow down, the only explanation that we’ve thought of for this perverse situation is that there is something out there in empty space that pushes rather than pulls. This has various possible names, but Dark Energy is probably the most popular, adding an appropriately noirish edge to this particular MacGuffin. It has even taken over in prominence from its much older relative, Dark Matter, although that one is still very much around.
We have very little idea what Dark Energy is, where it comes from, or how it relates to other forms of energy we are more familiar with, so observational astronomers have jumped in with various grandiose strategies to find out more about it. This has spawned a booming industry in surveys of the distant Universe (such as the Dark Energy Survey) all aimed ostensibly at unravelling the mystery of the Dark Energy. It seems that to get any funding at all for cosmology these days you have to sprinkle the phrase “Dark Energy” liberally throughout your grant applications.
The old-fashioned “observational” way of doing astronomy – by looking at things hard enough until something exciting appears (which it does with surprising regularity) – has been replaced by a more “experimental” approach, more like that of the LHC. We can no longer do deep surveys of galaxies to find out what’s out there. We have to do it “to constrain models of Dark Energy”. This is just one example of the not necessarily positive influence that particle physics has had on astronomy in recent times and it has been criticised very forcefully by Simon White.
Whatever the motivation for doing these projects now, they will undoubtedly lead to new discoveries. But my own view is that there will never be a solution of the Dark Energy problem until it is understood much better at a conceptual level, and that will probably mean major revisions of our theories of both gravity and matter. I venture to speculate that in twenty years or so people will look back on the obsession with Dark Energy with some amusement, as our theoretical language will have moved on sufficiently to make it seem irrelevant.
But that’s how it goes with MacGuffins. Even the Maltese Falcon turned out to be a fake in the end.
I was just re-reading this post over at Cosmic Variance about a paper by Sean Carroll, which he summarises as: Our observed universe is highly non-generic, and in the past it was even more non-generic, or “finely tuned.” One way of describing this state of affairs is to say that the early universe had a very low entropy. … The basic argument is an old one, going back to Roger Penrose in the late 1970′s. The advent of inflation in the early 1980 … Read More
I thought I’d reblog this post in order to send some traffic in its direction. The piece is asking for input concerning the science curriculum for Years 7 to 11. We didn’t have Years like this when I was at School, so I’ll translate this as meaning the age group 11 to 16, i.e. secondary school.
I’m going to have a think before I post a comment on the site, but I will do eventually, and I hope many of you will consider doing likewise.
You’ll have already gathered that I’m a school science adviser with the Hampshire Science Team. We support all schools in Hampshire in trying to develop exciting and inspiring science, as well as helping children make the best possible progress. Schools often feel under pressure to ‘teach to the test’ in order to achieve good examination results and this pressure can actually impede the development of good scientific thinking. Yesterday we began … Read More
Interesting that the Journal Nature is introducing a registration wall for its News pages. These pages have previously been free and, we’re told, will remain so. However, in order to access them one will now have to give a name and email address.
I heard about this On Wednesday (13th July) on Twitter (via @NatureNews):
OK, we’ve got some news that may annoy: @NatureNews is going to start requiring registration to view some of our free news stories. (1/2)
Don’t panic! All the news is still free. We’re just going to ask for a name and an email. (2/2)
(For those of you not among the Twitterati I should point out that messages on Twitter have to be less than 140 characters long, hence the use of two tweets in this case).
My immediate reaction – and that of manyof my colleagues – is that this looks very much like the strategy pursued by the Times online edition. First introduce registration, then shortly afterwards turn it into a paywall. In the meantime can collect all the email addresses in order to send marketing spam to those who have registered.
I inquired as to what they were planning to do with the email addresses they would be harvesting in this way, but didn’t get a satisfactory reply. Then I received a message from another branch of the Nature twitter operation, @npgnews:
@telescoper Hi Peter. Thanks for your comments. We’re about to send a series of tweets in response to Nature News registration.
Being a reserved British type I was a bit annoyed by the “Hi Peter” from someone I don’t know and have never spoken to before, but didn’t respond. Instead I waited with baited breath for the in-depth explanation of what Nature is going to do. Eventually it came, in three tweets:
Thx for your comments about the Nature News registration system. We’re asking all readers to introduce themselves by registering once (1/3)
Registration enables free access to the Nature News content, which remains unchanged. (2/3)
We’re working hard to expand and introduce more tailored services for readers and registration is necessary for that (3/3)
To say I found this disappointing would be an understatement. What a load of flannel. Note the word “enables” in Tweet No. 2. Free access was previously enabled to everyone, but is apparently to be disabled in order to facilitate the collection of user data for some unspecified purpose. Tweet No. 3 is a masterpiece of non sequitur. Why does expansion of Nature News require a database of email addresses? And what can “more tailored services” mean other than restricting access? Needless to say, I won’t be registering. There are other plenty of other sources of science information
Nature is of course a business operation, and you have to see this move against the wider backdrop of traditional publishing companies trying to find the way forward in the digital age. As a commercial enterprise, they are entitled to charge customers, although I wish they would be a little more honest about their intention to do so. I would remind them however, that The Times‘ paywall has been an unmitigated disaster, in terms of the negative an effect it has had on the readership figures. Given the revelations of the past weeks about the behaviour of News International, I bet people who were foolish enough to register are now wondering who has their personal information now. Will Nature News go the same way?
More importantly, however, as a scientist, I think that Nature’s policy of copyrighting and restricting general access to scientific papers is fundamentally wrong and is actively damaging science. I believe that scientific results should be in the public domain, as should the data on which they are based. Open access is the way it should be. In the past, publishers greatly assisted in the dissemination of research both between academics and to the public. Now, I’m afraid, the academic publishing industry is simply parasitic, and it is a threat to the health of scientific research. Fortunately, I don’t think a drastic remedy is needed; it will wither away on it’s own. Let’s just let Nature take its course.
Based on the popularity of something I posted last week, I thought some of you might find this little problem amusing. It’s from a Physics A-level paper I took in 1981. The examination comprised two papers in those days (and a practical exam); one paper had long questions, similar to the questions we set in university examinations these days, and the other was short questions in a multiple-choice format. This is one of the latter type, from the mechanics section.
And here is a poll in which you may select your answer:
A “Mr Smith” from Portugal drew my attention to this post. I’ve posted from time to time about my scepticism about bibliometricism and this piece suggests some radical alternatives to the way citations are handled. I’m not sure I agree with it, but it’s well worth reading.
In this, the 4th post in this series (the others on video abstracts, object oriented paper writing and freelance postdocs are here: 1,2,3), I would like to chat about a tough but important problem and present some proposals to address it, which vary from conservative to bordering on the extreme. Crazy ideas can be stimulating and fun, and I hope the proposals achieve at least one of these. They might even turn out to be useful. One can hope. The … Read More
Last Friday (13th March) the Royal Society launched a study into “openness in science”, as part of which they are inviting submisions from individuals and organizations. According to the Royal Society website
Science has always been about open debate. But incidents such as the UEA email leaks have prompted the Royal Society to look at how open science really is. With the advent of the Internet, the public now expect a greater degree of transparency. The impact of science on people’s lives, and the implications of scientific assessments for society and the economy are now so great that people won’t just believe scientists when they say “trust me, I’m an expert.” It is not just scientists who want to be able to see inside scientific datasets, to see how robust they are and ask difficult questions about their implications. Science has to adapt.”
I think this is a timely and important study which at the very least will reveal how different the attitude to this issue is between different science disciplines. On one extreme we have fields like astronomy, where the practice of making all data publically available is increasingly common and where most scientific publications are available free of charge through the arXiv. On the other there are fields where experimental data are generally regarded as the private property of the scientists involved in collecting the measurements or doing the experiments.
I have quite a simple view on this, which is that the default should be that data resulting from publically funded research should be in the public domain. I accept that this will not always be possible owing to ethical issues, such as when human subjects are involved, but that should be the default position.I have two reasons for thinking this way. One is that it’s public money that funds us, so we have a moral responsibility to be as open as possible with the public. The other is that the scientific method only works when analyses can be fully scrutinized and, if necessary, replicated by other researchers. In other words, to seek to prevent one’s data becoming freely available is profoundly unscientific.
I’m actually both surprised and depressed at the reluctance of some scientists to make their data available for scrutiny by other scientists, let alone members of the general public. I can give an example of my own experience of an encounter with a brick wall when trying to find out more about the statistics behind a study in the field of neuroscience. Other branches of physics are also way behind astronomy and cosmology in opening up their research.
If scientists are reluctant to share their data with other scientists it’s very difficult to believe they will be happy to put it all in the public domain. But I think they should. And I don’t mean just chucking terabytes of complicated unsorted data onto a website in such a way that it’s impossible in practice to make use of. I mean fully documented, carefully maintained databases with both raw data, analysis tools and data products. An exemplar is the excellent LAMBDA site which is a repository for data arising for research into the Cosmic Microwave Background.
I’ve ranted before (and will no doubt do so again) about the extremely negative effect the academic publishing industry has on the dissemination of results. At out latest Board of Studies meeting, the prospect of further cuts to our library budget was raised and the suggestion made that we might have to cancel some of our journal subscriptions. I, and most of my astronomy colleagues, frankly don’t really care if we cancel astronomy journals. All our relevant papers can be found on the arXiv and/or via the NASA/ADS system. My physics colleagues, on the other hand, are still in hock to the old-fashioned and ruinously expensive academic journal racket.
One of the questions the Royal Society study will ask is:
How do we make information more accessible and who will pay to do it?
I’m willing to hazard a guess that if we worked out how much universities and research laboratories are spending on pointless journal subscriptions, then we’d find that it’s more than enough to pay for the construction and maintenance of sufficient open access repositories. The current system of publishing could easily be scrapped, and replaced by something radically different, but it won’t be easy to change to a new approach more suited to the era of the internet. For example, at present we are forced to publish in “proper journals” for the purposes of research assessments, so that academic publishers wield immense power over university researchers. These vested interests will be difficult to overthrow, but I think there’s a growing realization that they are actively preventing science adjusting properly to the digital age.
Anyway, whether or not you agree with me, I hope you’ll agree that the Royal Society study is an important one so please take a look and contribute if you can.
The views presented here are personal and not necessarily those of my employer (or anyone else for that matter).
Feel free to comment on any of the posts on this blog but comments may be moderated; anonymous comments and any considered by me to be vexatious and/or abusive and/or defamatory will not be accepted. I do not necessarily endorse, support, sanction, encourage, verify or agree with the opinions or statements of any information or other content in the comments on this site and do not in any way guarantee their accuracy or reliability.