NeuroDojo: We do not need new journals for negative results

lterrat's bookmarks 2017-05-02

Summary:

"I think the underlying problem with discussions of negative results is that we talk about 'negative results' as though they were all the same, scientifically: 'no effect.' All negative results are not equivalent; some are more interesting than others. Below is a crude first attempt to rank them. 

  1. Negative results that refute strongly held hypotheses. Physicists hypothesized that space contained an aether. Nope. Harry Whittington though the Burgess Shale fossil, Opabinia, was an arthropod. Nope. That was just a big old bunch of negative results. But they were clearly recognized as important in getting us off the wrong path.
  2. Negative results that fail to replicate an effect. These are tricky. We all recognize that replication is important, but how we react to them differs. Sometimes, failure to replicate is seen as important is demonstrating incorrect claims (like Rosie Redfield and others showing that GFAJ-1 bacteria, sometimes referred to as 'arsenic life', did indeed have phosphorus in its DNA rather than arsenic as initially claimed). Sometimes, failure to replicate can be dismissed as technical incompetence.
  3. 'Hey, I wonder if...' (HIWI*) negative results. These are negative results that have no strong hypotheses driving the experimental outcome. Like asking, “What is the effect of gamma rays on man-in-the-moon marigolds?” Well, do you have any reason to believe that gamma rays would affect the marigolds differently than other organisms? If you don’t, negative results are deeply uninteresting.

In other words, that results are negative has very little bearing on how people view their importance. The importance of the hypothesis that underlies those negative results play a much bigger role in whether people are liable to think those negative results are interesting. That is, even if you have another journal specifically for negative results, people are still going to think some results are more interesting and publishable than others. People whose negative results fall into the HIWI category (which may be a lot of those experiments) are still going to have a rough ride in publication, even for journals that consider negative results."

Link:

http://neurodojo.blogspot.com/2017/05/we-do-not-need-new-journals-for.html

From feeds:

Open Access Tracking Project (OATP) » lterrat's bookmarks

Tags:

oa.stem oa.journals

Date tagged:

05/02/2017, 21:52

Date published:

05/02/2017, 17:52