Headline Story | equities.com -- Worth the paper it’s on?

“More than half of biomedical research cannot be replicated. We urgently need to do something about it, says Elizabeth Iorns  REPRODUCIBILITY is the cornerstone of science. What we hold as definitive scientific fact has been tested over and over again. Even when a fact has been tested in this way, it may still be superseded by new knowledge. Newtonian mechanics became a special case of Einstein's general relativity; molecular biology's mantra ‘one gene, one protein’ became a special case of DNA transcription and translation.  One goal of scientific publication is to share results in enough detail to allow other research teams to reproduce them and build on them. However, many recent reports have raised the alarm that a shocking amount of the published literature in fields ranging from cancer biology to psychology is not reproducible.  Pharmaceuticals company Bayer, for example, recently revealed that it fails to replicate about two-thirds of published studies identifying possible drug targets (Nature Reviews Drug Discovery, vol 10, p 712).  Bayer's rival Amgen reported an even higher rate of failure?- over the past decade its oncology and haematology researchers could not replicate 47 of 53 highly promising results they examined (Nature, vol 483, p 531). Because drug companies scour the scientific literature for promising leads, this is a good way to estimate how much biomedical research cannot be replicated. The answer: the majority.  The reasons for this are myriad. The natural world is complex, and experimental methods do not always capture all possible variables. Funding is limited and the need to publish quickly is increasing.  There are human factors, too. The pressure to cut corners, to see what one wants and believes to be true, to extract a positive outcome from months or years of hard work, and the impossibility of being an expert in all the experimental techniques required in a high-impact paper are all contributing factors.  The cost of this failure is high... Drug companies have spent vast amounts of time and money trying and failing to reproduce potential drug targets reported in the scientific literature?- resources that should have contributed towards curing diseases.  Failed replications also quite often go unpublished, thereby leading others to repeat the same failed efforts ...  instead of punishing investigators, what if there was a way of rewarding them for pursuing independent replication of their most significant scientific results?- the ones they want to see cited and built on?- before or shortly after publication? I believe this could be a substantial boon to science and society, which is why I started the Reproducibility Initiative.  I am the co-founder and CEO of Science Exchange, part of the initiative. It is an online marketplace to connect scientific services, such as DNA sequencing, with people who need them. The exchange lists more than 1000 experts in techniques including sequencing, electron microscopy and mass spectrometry. They mostly provide services to their own institute, but are open to other work on a fee-paying basis.  Thinking about the reproducibility problem, I realised that Science Exchange could help by providing investigators with the means and incentives to obtain independent validation of their results.  Here's how it works. Scientists submit studies to us that they would like to see replicated. Our independent scientific advisory board?- all members of which are leaders in their fields as well as advocates on the reproducibility problem - selects studies for replication. Service providers are then selected at random to conduct the experiments, and the results are returned to the original investigators, who can then publish them in a special issue of the open-access journal PLoS ONE. We will issue a ‘certificate of reproducibility’ for studies that are successfully replicated.  In our pilot phase, we expect to attempt to replicate 40 to 50 studies. We also plan to publish an analysis of the overall success of what is essentially an experiment in reproducibility...”