Archive for the Open Access Category

A Name for Open Astrophysics?

Posted in Open Access with tags , , , , , on November 4, 2012 by telescoper

Regular readers of this blog may recall that  while ago  I posted an item in which I suggested setting up The Open Journal of Astrophysics. The motivation behind this was to demonstrate that it is possible to run an academic journal which is freely available to anyone who wants to read it, as well as at minimal cost to authors. Basically, I want to show that it is possible to “cut out the middle man” in the process of publishing scientific research and that by doing it ourselves we can actually do it better.

I was unwell for much of the summer, and more recently have had lots to do in connection with my forthcoming move to Sussex, so things have moved more slowly than I’d hoped but I just wanted to take this opportunity to give my assurance that this project is definitely going ahead. We have a (good) website design with ample space and other resources to run it, and a sufficient number of persons of suitable eminence have agreed to serve on the Editorial Board. It will basically be a front-end for the Arxiv, but will have a number of interesting additional features which make it a lot  more than that.  I’d prefer to save further details to the official launch, which is now planned to take place in January (as it would probably get buried in the pre-Xmas rush if we tried to launch before then). I can also confirm that the service we will provide will be free at the start, although if the volume of submissions grows we may have to charge a small fee for refereeing. And when I say “small” I mean small, not the hundreds or thousands of pounds charged by the rip-off merchants.

One thing I would like some ideas about, however, is the name. My working title for this project is The Open Journal of Astrophysics, which I think is OK but what I’d really like to do is break away from the old language of academic publishing as much as possible. I did think of the People’s Revolutionary Journal of Astrophysics, but feared that it might then split into Trotskyite and Marxist-Leninist factions. In any case the very name “journal” suggests something published periodically, whereas my idea is to have something that is updated continuously whenever papers are accepted. I’m therefore having second thoughts about having the word “Journal” in the title at all. Open Astrophysics might suffice, but I’m sure someone out there can come up with a better name. I know that Shakespeare said that a rose by any other name would smell as sweet, but I think a good title might make the difference between success and failure for this initiative…

That gives me the idea of enlisting the help of the denizens of the internet for some help in coming up with a better title; given the nature of the project, this seems an entirely appropriate way of proceeding. So please engage in collective or individual brainstorming sessions and let me have your suggestions through the comments box!

The Tremors from L’Aquila

Posted in Bad Statistics, Open Access, Science Politics with tags , , , on October 23, 2012 by telescoper

I can’t resist a comment on news which broke yesterday that an Italian court has found six scientists and a former government official guilty of manslaughter in connection with the L’Aquila Earthquake of 2009. Scientific colleagues of mine are shocked by their conviction and by the severity of the sentences (six years’ imprisonment), the assumption being that they were convicted for having failed to predict the earthquake. However, as Nature News pointed out long before the trial when the scientists were indicted:

The view from L’Aquila, however, is quite different. Prosecutors and the families of victims alike say that the trial has nothing to do with the ability to predict earthquakes, and everything to do with the failure of government-appointed scientists serving on an advisory panel to adequately evaluate, and then communicate, the potential risk to the local population. The charges, detailed in a 224-page document filed by Picuti, allege that members of the National Commission for Forecasting and Predicting Great Risks, who held a special meeting in L’Aquila the week before the earthquake, provided “incomplete, imprecise, and contradictory information” to a public that had been unnerved by months of persistent, low-level tremors. Picuti says that the commission was more interested in pacifying the local population than in giving clear advice about earthquake preparedness.

“I’m not crazy,” Picuti says. “I know they can’t predict earthquakes. The basis of the charges is not that they didn’t predict the earthquake. As functionaries of the state, they had certain duties imposed by law: to evaluate and characterize the risks that were present in L’Aquila.” Part of that risk assessment, he says, should have included the density of the urban population and the known fragility of many ancient buildings in the city centre. “They were obligated to evaluate the degree of risk given all these factors,” he says, “and they did not.”

Many of my colleagues have interpreted the conviction of these scientists as an attack on science, but the above statement actually looks to me more like a demand that the scientists involved should have been more scientific. By that I mean not giving a simple “yes” or “no” answer (which in this case was “no”) but by give a proper scientific analysis of the probabilities involved. This comment goes straight to two issues that I feel very strongly about. One is the vital importance of probabilistic reasoning – in this case in connection with a risk assessment – and the other is the need for openness in science.

I thought I’d take this opportunity to repeat the reasons I think statistics and statistical reasoning are so important. Of course they are important in science. In fact, I think they lie at the very core of the scientific method, although I am still surprised how few practising scientists are comfortable even with statistical language. A more important problem is the popular impression that science is about facts and absolute truths. It isn’t. It’s a process. In order to advance, it has to question itself.

Statistical reasoning also applies outside science to many facets of everyday life, including business, commerce, transport, the media, and politics. It is a feature of everyday life that science and technology are deeply embedded in every aspect of what we do each day. Science has given us greater levels of comfort, better health care, and a plethora of labour-saving devices. It has also given us unprecedented ability to destroy the environment and each other, whether through accident or design. Probability even plays a role in personal relationships, though mostly at a subconscious level.

Civilized societies face severe challenges in this century. We must confront the threat of climate change and forthcoming energy crises. We must find better ways of resolving conflicts peacefully lest nuclear or conventional weapons lead us to global catastrophe. We must stop large-scale pollution or systematic destruction of the biosphere that nurtures us. And we must do all of these things without abandoning the many positive things that science has brought us. Abandoning science and rationality by retreating into religious or political fundamentalism would be a catastrophe for humanity.

Unfortunately, recent decades have seen a wholesale breakdown of trust between scientists and the public at large; the conviction of the scientists in the L’Aquila case is just one example. This breakdown is due partly to the deliberate abuse of science for immoral purposes, and partly to the sheer carelessness with which various agencies have exploited scientific discoveries without proper evaluation of the risks involved. The abuse of statistical arguments have undoubtedly contributed to the suspicion with which many individuals view science.

There is an increasing alienation between scientists and the general public. Many fewer students enrol for courses in physics and chemistry than a a few decades ago. Fewer graduates mean fewer qualified science teachers in schools. This is a vicious cycle that threatens our future. It must be broken.

The danger is that the decreasing level of understanding of science in society means that knowledge (as well as its consequent power) becomes concentrated in the minds of a few individuals. This could have dire consequences for the future of our democracy. Even as things stand now, very few Members of Parliament are scientifically literate. How can we expect to control the application of science when the necessary understanding rests with an unelected “priesthood” that is hardly understood by, or represented in, our democratic institutions?

Very few journalists or television producers know enough about science to report sensibly on the latest discoveries or controversies. As a result, important matters that the public needs to know about do not appear at all in the media, or if they do it is in such a garbled fashion that they do more harm than good.

Years ago I used to listen to radio interviews with scientists on the Today programme on BBC Radio 4. I even did such an interview once. It is a deeply frustrating experience. The scientist usually starts by explaining what the discovery is about in the way a scientist should, with careful statements of what is assumed, how the data is interpreted, and what other possible interpretations might be and the likely sources of error. The interviewer then loses patience and asks for a yes or no answer. The scientist tries to continue, but is badgered. Either the interview ends as a row, or the scientist ends up stating a grossly oversimplified version of the story.

Some scientists offer the oversimplified version at the outset, of course, and these are the ones that contribute to the image of scientists as priests. Such individuals often believe in their theories in exactly the same way that some people believe religiously. Not with the conditional and possibly temporary belief that characterizes the scientific method, but with the unquestioning fervour of an unthinking zealot. This approach may pay off for the individual in the short term, in popular esteem and media recognition – but when it goes wrong it is science as a whole that suffers. When a result that has been proclaimed certain is later shown to be false, the result is widespread disillusionment. And the more secretive the behaviour of the scientific community, the less reason the public has to trust its pronouncements.

I don’t have any easy answers to the question of how to cure this malaise, but do have a few suggestions. It would be easy for a scientist such as myself to blame everything on the media and the education system, but in fact I think the responsibility lies mainly with ourselves. We are usually so obsessed with our own research, and the need to publish specialist papers by the lorry-load in order to advance our own careers that we usually spend very little time explaining what we do to the public or why we do it.

I think every working scientist in the country should be required to spend at least 10% of their time working in schools or with the general media on “outreach”, including writing blogs like this. People in my field – astronomers and cosmologists – do this quite a lot, but these are areas where the public has some empathy with what we do. If only biologists, chemists, nuclear physicists and the rest were viewed in such a friendly light. Doing this sort of thing is not easy, especially when it comes to saying something on the radio that the interviewer does not want to hear. Media training for scientists has been a welcome recent innovation for some branches of science, but most of my colleagues have never had any help at all in this direction.

The second thing that must be done is to improve the dire state of science education in schools. Over the last two decades the national curriculum for British schools has been dumbed down to the point of absurdity. Pupils that leave school at 18 having taken “Advanced Level” physics do so with no useful knowledge of physics at all, even if they have obtained the highest grade. I do not at all blame the students for this; they can only do what they are asked to do. It’s all the fault of the educationalists, who have done the best they can for a long time to convince our young people that science is too hard for them. Science can be difficult, of course, and not everyone will be able to make a career out of it. But that doesn’t mean that it should not be taught properly to those that can take it in. If some students find it is not for them, then so be it. I always wanted to be a musician, but never had the talent for it.

The third thing that has to be done is for scientists to be far more open. Publicly-funded scientists have a duty not only to publish their conclusions in such a way that the public can access them freely, but also to publish their data, their methodology and the intermediate steps. Most members of the public will struggle to make sense of the information, but at least there will be able to see that nothing is being deliberately concealed.

Everyone knows that earthquake prediction is practically impossible to do accurately. The danger of the judgement in the L’Aquila Earthquake trial (apart from discouraging scientists from ever becoming seismologists) is that the alarm will be sounded every time there is the smallest tremor. The potential for panic is enormous. But the science in this field,as in any other, does not actually tell one how to act on evidence of risk, merely to assess it. It’s up to others to decide whether and when to act, when the threshold of danger has been crossed. There is no scientific answer to the question “how risky is too risky?”.

So instead of bland reassurances or needless panic-mongering, the scientific community should refrain from public statements about what will happen and what won’t and instead busy itself with the collection, analysis and interpretation of data and publish its studies as openly as possible. The public will find it very difficult to handle this information overload, but so they should. Difficult questions don’t have simple answers. Scientists aren’t priests.

Whither the Learned Societies?

Posted in Open Access with tags , , , , on October 1, 2012 by telescoper

An interesting aspect of the ongoing debate about Open Access publishing is the extent to which “learned societies”, such as the Royal Astronomical Society and the Institute of Physics, rely for their financial security upon the revenues generated by publishing traditional journals.

IOP Publishing is a wholly-owned subsidiary of the Institute of Physics that generates annual income  in the region of £40M from books and journals. This is the largest source of the revenue that the IoP needs to run its numerous activities relating to the promotion of physics.  A similar situation pertains to the Royal Astronomical Society, although on a smaller scale, as it relies for much of its income from Monthly Notices of the Royal Astronomical Society, in which as a matter of fact I publish quite regularly.

Not surprisingly, these and other learned societies are keen to protect their main source of cash. When I criticized the exploitative behaviour of IoP Publishing in a recent blog post, I drew a stern response from the Chief Executive of the Institute of Physics, Paul Hardaker. That comment seems to admit that the high prices charged by IOP Publishing for access to  its journals is nothing to do with the cost of disseminating scientific knowledge but is instead a means of generating income to allow the IoP to pursue its noble aim of  “promoting Physics”. This explains why such organizations have lobbied very hard for the “Gold” Open Access that is being foisted on the research community, rather than the “Green” Open Access that it really wants.

I recently came across another blog post, pointing out that other learned societies around the world are also opposing Green Open Access:

There is also great incentive for the people who manage and run these organisations to defend their cartel. For example, the American Chemical Society, a huge opponent to open access, pays many of its employees, as reported in their 990 tax return, over six figures. These salaries range from $304,528 to $1,084,417 in 2010.

I don’t know the salary of the Chief Executive of the IoP.

The problem with the learned societies behaving this way is twofold. First, I consider it to be inevitable that the traditional journal industry will very soon be completely bypassed in favour of Green Open Access. The internet has changed the entire landscape of scientific publication. It’s now so cheap and so easy to disseminate knowledge that journals are already  redundant, especially in my field of astrophysics. The comfortable income stream that has been used by the IoP to “promote Physics”, as well as to furnish its spacious  buildings in Portland Place and pay the no doubt “competitive” salaries of its officers, will therefore surely dry up in the near future.  The “Gold” OA favoured by such organizations is unjustifiable and unsustainable and it won’t last. The IoP, RAS et al need to find another way of funding their activities pronto, or downsize accordingly.

The other problematic aspect of this  approach is that I think it is fundamentally dishonest. University and institutional libraries are provided with funds to provide access to published research, not to provide a backdoor subsidy for a range of extraneous activities that have nothing to do with disseminating research. The learned societies do many good things – and some are indeed oustandingly good – but that does not give them the right to syphon off funds from their constituents in this way.  Institutional affiliation, paid for by fee, would be a much fairer way of funding these activities.

I should point out that, as a FRAS and a FInstP, I pay annual subscriptions to both the RAS and the IoP. I am happy to do so, as I feel comfortable spending some of my own money supporting astronomy and physics. What I don’t agree with is my department having to fork out huge amounts of money from an ever-dwindling budget for access to scientific research that should be in the public domain because it has already been funded by the taxpayer.

Some time ago I had occasion to visit the London offices of a well-known charitable organization which shall remain nameless. The property they occupied was glitzy, palatial and obviously very expensive. I couldn’t help wondering how they could square the opulence of their headquarters with the quoted desire to spend as much as possible on their good works. Being old and cynical, I came to the conclusion that, although charities might start out with the noblest intentions, there is a grave danger that they simply become self-serving, viewing their own existence in itself as more important than what they do for others.

The academic publishing industry has definitely gone that way. It arose because of the need to review, edit, collate, publish and disseminate the fruits of academic labour. Then the ease with which profits could be made led it astray. It now fulfils little or no useful purpose, but simply consumes financial resources that could be put to much better effect actually doing science. Fortunately, I think the scientific community knows this and the parasite will die a natural death.

But I wonder if the learned societies will go the same way.  Is there a financial model according to which they can enjoy a stable and sustainable future?  Are they actually needed? After all, if we can publish our own physics, why can’t we ourselves also promote it?

Particle physics volunteers to be fleeced….

Posted in Open Access with tags , , , , on September 26, 2012 by telescoper

I heard the news yesterday that a body called the Sponsoring Consortium for Open Access Publishing in Particle Physics (SCOAP3) has arranged a deal whereby virtually all articles in particle physics will be available for free on journal websites. The deal will mean that authors will not have to pay thousands of dollars up-front in “article processing charges” in order to have their work available via Open Access media.

So far so good, you’re probably thinking. But read a little bit more about it and it becomes absolutely clear that SCOAP3 has walked straight into a trap laid by the academic publishers with whom it brokered the agreement. The principal deterrent to authors publishing via the “Gold” Open Access model has been that they would have to pay up-front fees, potentially around $2000 for each paper. Any sensible researcher would rather spend $2000 supporting their research than lining the profits of greedy publishers, so would probably opt for a “green” mode instead. Indeed many particle physicists already do this, putting their work on the arxiv where it is available for free anyway.

The publishing industry realises that most authors would simply bypass it and go for self-publication if they could, so it is naturally very keen on deals like this. What actually happens in the SCOAP3 agreement is that an author’s institution pays fees directly to the publisher. According to Nature News:

The consortium will pay the contracts from an annual budget of €10 million, which is funded not by authors or research grants, but by pledges from more than a thousand libraries, funding agencies and research consortia across the world. In effect, existing journal subscription fees are being repurposed to provide the open-access funds.

And there’s the rub. “Existing journal subscription fees” are already extortionately high, and out of all proportion to the actual cost of disseminating scientific knowledge. Authors may think that they’re not paying for Open Access under the new agreement, but in fact they are. It’s just a bit less direct. Their grants will continue to be top-sliced to pay for the SCOAP3 arrangement and, since science budgets are unlikely to rise for the foreseeable future, that means the cash available for actually doing research will fall. This agreement is very good for the publishers, but very bad for science.

The average cost for Open Access publication in Physics Review D. under the new scheme will be $1900 per paper. Ouch! And how does the publisher justify this cost? “To maintain revenue levels…”. I rest my case.

More of the  is going to happen in the UK, where £10M is being set aside from existing Research Council budgets, nominally to “pay for the transition to Open Access” but actually in order to maintain profit levels at the big academic publishing houses. Much of that £10M will no doubt disappear in deals like the one brokered by SCOAP3.  And that means continuing high profits for the publishers at the expense of falling levels of research funding. The whole thing stinks.

And if as an author you decide that you have a moral objection to being scammed in this way, under the SCOAP3 agreement you now have no way out. Even if you bypass the arrangement and just publish on the arXiv, the publishers will get their money directly anyway. You have to admit it’s a clever sting, but I’m still surprised the particle physics community has fallen for it.

This development convinced me even more that the research community has to take matters into its own hands, and organize its own publication strategy. Traditional journals are already virtually redundant and I confidently predict they will die a natural death in just a few years, but while they linger on their publishers will continue to fleece the academic community as long as they can. The sooner we put a stop to it the better.

Nothing Gold Can Stay

Posted in Open Access, Poetry with tags , , , on September 13, 2012 by telescoper

Nature’s first green is gold,
Her hardest hue to hold.
Her early leaf’s a flower;
But only so an hour.
Then leaf subsides to leaf.
So Eden sank to grief,
So dawn goes down to day.
Nothing gold can stay.

by Robert Frost (1874-1963)

Time to go it alone on Open Access

Posted in Open Access, Science Politics with tags , , , , on September 10, 2012 by telescoper

Not at all surprisingly, the government has announced  that existing research council budgets are to be raided to provide funds (to the tune of £10M) to pay for “Gold” Open Access to scientific research. This is the model of open access in which most authors will have to pay publishers a whopping fee up front in order to disseminate their work. The figures being talked about are in the region of £2000 per paper by way of an “article processing fee”.

I put “article processing fee” in quotes there because a fee of that size bears no relation to the actual cost to the publishers of processing an article: articles in most physics journals are typeset by the author, and refereed for free by other academics suggested by the editor (another academic).  What it really represents is the amount of money researchers will have to pay to maintain the humongous profit margins currently enjoyed by the academic publishing industry. Currently they rake in the cash through subscription charges after papers have been published in their journals . In future they will get the dosh in advance, which will probably make their business even more lucrative. And who will pay for maintaining their profitability? Researchers, of course. It’s clear who is going to benefit from the provisions of the Finch Report, and it’s not us.

Not surprisingly the publishing racketeers want to try to make us think they provide a worthwhile service for all the money they sting us for. For example, in this month’s Physics World, there’s a response from Steven Hall (Managing Director of IOP Publishing) to a letter from a certain Dr Garrrett. The original letter pointed the facts of the current state of affairs that I have bemoaned on many occasion on this blog:

Currently, researchers have to typeset their own work, sign away the copyright to publishers and referee the work of their peers – all for no remuneration. They then pay large sums in publication fees or library subscriptions to buy that work back in refereed and collated form.

Steven Hall’s response includes the following paragraph:

Researchers do not perform peer review alone: publishers organize and manage it, invest in people and systems to facilitate it, appoint and support editorial boards to oversee it and develop journals to meet the needs of scientific communities.

This is very far from being an accurate or fair representation of the way things work, at least not in physics. Researchers do carry out peer review alone. And unpaid. The main system that facilitates it is email (which, to my knowledge, was not developed by the academic publishing industry). And the journals that IOP develops are less to do with the “needs” of scientific communities than they are with the desires of a profit-making company to exploit said communities for even greater commercial gain.

Don’t you think it’s very strange that in a time of shrinking library budgets the number of journals seems to be growing all the time? Do we really need new ones? Do we even need the old ones? I think not.

And for those of you who think that IOP Publishing, as a part of the Institute of Physics, must be acting in the best interests of physics research, that’s simply not the case. It’s run as a private publishing company that behaves in exactly the same unscrupulous profiteering manner as, e.g. Elsevier. The IOP’s Open Access journals already charge £1700 per paper in article processing fees. They’re also in the habit of peddling meaningless “impact factor” statistics when trying to market their journals, many of which have lamentably poor citation rates despite their extortionate costs. Hence the IOP’s practice of bundling journal subscriptions in order to force institutions who want the good stuff to pay for the dross as well.

Having looked carefully into the costs of on-line digital publishing I have come to the conclusion that a properly-run, not-for-profit journal, created for and run by researchers purely for the open dissemination of the fruits of their research can be made sustainable with an article processing charge of less than £50 per paper, probably a lot less.

There’s only one response possible to those who’ve hijacked the Finch committee to serve their own ends, and that is to cut them out of the process. I think we can do it better (and cheaper)  ourselves. And very soon I hope to prove it.

Open Journal of Astrophysics: Update

Posted in Open Access with tags , , , , , on August 27, 2012 by telescoper

Regular readers of this blog (Sid and Doris Bonkers) may recall that a few weeks ago I posted an item in which I suggested setting up The Open Journal of Astrophysics. The motivation behind this was to demonstrate that it is possible to run an academic journal which is freely available to anyone who wants to read it, as well as at minimal cost to authors. Basically, I want to show that it is possible to “cut out the middle man” in the process of publishing scientific research and that by doing it ourselves we can actually do it better.

I have been unwell for much of the summer, so haven’t been able to carry this project on as much as I would have liked, and  I also received many messages offering help and advice that I have been unable to reply to individually. But I can assure you that I haven’t forgotten about the idea, nor have I quietly withdrawn the financial backing I suggested in my earlier post. Indeed, my interest in, and excitement, about this project has grown significantly over the summer as new possibilities have been suggested and my resentment about how the academic publishing industry hijacked the Finch Report has deepened.

In fact, quite a lot of effort has already been put in by people elsewhere thinking about how to set this journal up in the best way to make maximal use of digital technology to produce something radically different from the stale formats offered by existing journals.  I hope to be able to report back soon with more details of how it will work, when we propose to launch the site, and even what its name will be, Open Journal of Astrophysics being just a working title. I think it’s far better to wait until we have a full prototype going before going further.

In the meantime, however, I have a request to make. The Open Journal of Astrophysics will need an Editorial Board with expertise across all astrophysics, so they can select referees and deal with the associated correspondence.  The success of this venture will largely depend on establishing trust with the research community and one way of doing that will be by having eminent individuals on the Editorial Board. I will be contacting privately various scientists who have already offered their assistance in this, but if any senior astronomers and/or astrophysicists out there are interested in playing a part please contact me. I can’t offer much in the way of remuneration, but I think this is an opportunity to get involved in a venture that in the long run will benefit the astronomical community immensely.

Oh, and please feel free pass this on to folks you think might be interested even if you yourself are not!

The Impact X-Factor

Posted in Bad Statistics, Open Access with tags , , on August 14, 2012 by telescoper

Just time for a quick (yet still rather tardy) post to direct your attention to an excellent polemical piece by Stephen Curry pointing out the pointlessness of Journal Impact Factors. For those of you in blissful ignorance about the statistical aberration that is the JIF, it’s basically a measure of the average number of citations attracted by a paper published in a given journal. The idea is that if you publish a paper in a journal with a large JIF then it’s in among a number of papers that are highly cited and therefore presumably high quality. Using a form of Proof by Association, your paper must therefore be excellent too, hanging around with tall people being a tried-and-tested way of becoming tall.

I won’t repeat all Stephen Curry’s arguments as to why this is bollocks – read the piece for yourself – but one of the most important is that the distribution of citations per paper is extremely skewed, so the average is dragged upwards by a few papers with huge numbers of citations. As a consequence most papers published in a journal with a large JIF attract many fewer citations than the average. Moreover, modern bibliometric databases make it quite easy to extract citation information for individual papers, which is what is relevant if you’re trying to judge the quality impact of a particular piece of work, so why bother with the JIF at all?

I will however copy the summary, which is to the point:

So consider all that we know of impact factors and think on this: if you use impact factors you are statistically illiterate.

  • If you include journal impact factors in the list of publications in your cv, you are statistically illiterate.
  • If you are judging grant or promotion applications and find yourself scanning the applicant’s publications, checking off the impact factors, you are statistically illiterate.
  • If you publish a journal that trumpets its impact factor in adverts or emails, you are statistically illiterate. (If you trumpet that impact factor to three decimal places, there is little hope for you.)
  • If you see someone else using impact factors and make no attempt at correction, you connive at statistical illiteracy.

Statistical illiteracy is by no means as rare among scientists as we’d like to think, but at least I can say that I pay no attention whatsoever to Journal Impact Factors. In fact I don’t think many people in in astronomy or astrophysics use them at all. I’d be interested to hear from anyone who does.

I’d like to add a little coda to Stephen Curry’s argument. I’d say that if you publish a paper in a journal with a large JIF (e.g. Nature) but the paper turns out to attract very few citations then the paper should be penalised in a bibliometric analysis, rather like the handicap system used in horse racing or golf. If, despite the press hype and other tedious trumpetings associated with the publication of a Nature paper, the work still attracts negligible interest then it must really be a stinker and should be rated as such by grant panels, etc. Likewise if you publish a paper in a less impactful journal which nevertheless becomes a citation hit then it should be given extra kudos because it has gained recognition by quality alone.

Of course citation numbers don’t necessarily mean quality. Many excellent papers are slow burners from a bibliometric point of view. However, if a journal markets itself as being a vehicle for papers that are intended to attract large citation counts and a paper published there flops then I think it should attract a black mark. Hoist it on its own petard, as it were.

So I suggest papers be awarded an Impact X-Factor, based on the difference between its citation count and the JIF for the journal. For most papers this will of course be negative, which would serve their authors right for mentioning the Impact Factor in the first place.

PS. I chose the name “X-factor” as in the TV show precisely for its negative connotations.

The Low-down on the LHC Boson

Posted in Open Access, The Universe and Stuff with tags , , , , , , on August 2, 2012 by telescoper

Although it’s a little late I thought I’d just put up a brief post to draw your attention to the news that a couple of technical papers have appeared on the arXiv giving updated details of the recent discovery at the Large Hadron of a new scalar particle that could be the Higgs boson. I don’t think it’s yet absolutely proven that this is what the new particle is, which is why I’ve called it the “LHC boson” in the title.

The ATLAS paper reports the detection of a Higgs-like particle with a 5.9 sigma confidence level, up from the 5.0 sigma reported on July 4. Here’s the abstract:

A search for the Standard Model Higgs boson in proton-proton collisions with the ATLAS detector at the LHC is presented. The datasets used correspond to integrated luminosities of approximately 4.8 fb^-1 collected at sqrt(s) = 7 TeV in 2011 and 5.8 fb^-1 at sqrt(s) = 8 TeV in 2012. Individual searches in the channels H->ZZ^(*)->llll, H->gamma gamma and H->WW->e nu mu nu in the 8 TeV data are combined with previously published results of searches for H->ZZ^(*), WW^(*), bbbar and tau^+tau^- in the 7 TeV data and results from improved analyses of the H->ZZ^(*)->llll and H->gamma gamma channels in the 7 TeV data. Clear evidence for the production of a neutral boson with a measured mass of 126.0 +/- 0.4(stat) +/- 0.4(sys) GeV is presented. This observation, which has a significance of 5.9 standard deviations, corresponding to a background fluctuation probability of 1.7×10^-9, is compatible with the production and decay of the Standard Model Higgs boson.

The paper from CMS reinforces the discovery of a Higgs-like particle with a mass of 125 GeV at a 5-sigma level of confidence:

Results are presented from searches for the standard model Higgs boson in proton-proton collisions at sqrt(s)=7 and 8 TeV in the CMS experiment at the LHC, using data samples corresponding to integrated luminosities of up to 5.1 inverse femtobarns at 7 TeV and 5.3 inverse femtobarns at 8 TeV. The search is performed in five decay modes: gamma gamma, ZZ, WW, tau tau, and b b-bar. An excess of events is observed above the expected background, a local significance of 5.0 standard deviations, at a mass near 125 GeV, signalling the production of a new particle. The expected significance for a standard model Higgs boson of that mass is 5.8 standard deviations. The excess is most significant in the two decay modes with the best mass resolution, gamma gamma and ZZ; a fit to these signals gives a mass of 125.3 +/- 0.4 (stat.) +/- 0.5 (syst.) GeV. The decay to two photons indicates that the new particle is a boson with spin different from one.

I’ll refrain from commenting on the use of frequentist language in both these papers, but instead just comment that these extremely important papers are available for free on the arXiv. Open access, we call it.

PS. There’s an interesting blog post related to these papers, about citations in particle physics here.

A Modest Proposal – The Open Journal of Astrophysics

Posted in Open Access with tags , , on July 17, 2012 by telescoper

Following on from yesterday’s piece, I thought I’d make a quick suggestion.

Astrophysics has taken the lead for many years in opening up access to scientific publications – all publications of any merit are available for free on the internet via the arXiv and, in my opinion, the traditional journals are already more-or-less redundant even without considering their “astronomical” cost. The one thing that seems a consistent objection to dispensing with journals altogether is the element of peer review.

However, yesterday’s news that many of us are probably going to have to pay up front fees to publish papers (at thousands of pounds  a pop) will no doubt have convinced many that the government’s decision is potentially ruinous for science. I think it’s time for astrophysics to lead the way again.

My suggestion is that we set up a quick-and-easy trial system to circumvent the traditional publishing route. The basic is that authors who submit papers to the arXiv can have their papers refereed by the community, outside the usual system of traditional journals. I’m thinking of a website on which authors would simply have to post their arXiv ID and a request for peer review. Once accepted, the author would be allowed to mark the arXiv posting as “refereed” and an electronic version would be made available for free on the website.

Although there are many issues to be sorted out,  a limited trial of The Open Journal of Astrophysics could I think happen very soon, perhaps even before the REF.

This idea would require community support setting it up (and doing the refereeing/administration)  and it would probably only get off the ground if sufficient senior astronomers get on board. It will no doubt also take money to get it going. However, I feel sufficiently strongly about this that I’m prepared to stump up £10k from my own pocket just to get it started.

If anyone has ideas about how to take this project forward, is willing to help with technical expertise, or if any prominent astronomers would simply like to add their name in support of the idea please do so through the comments box below.  Any further pledges of financial support would of course also be welcome.

And please pass this message on via Twitter/email/whatever, so I can gauge the level of support.