This Study Was Hailed as a Win for Science Reform. Now It’s Being Retracted.

peter.suber's bookmarks 2024-09-25

Summary:

"At first, it looked like a paradigm of science done right. A group of behavioral scientists had repeated the same experiments over and over in separate labs, following the same rigorous methods, and found that 86 percent of their attempts had the results they expected.

In a field where the seemingly constant collapse of influential discoveries over the past decade has triggered a reproducibility crisis, this finding was welcome news. The study’s authors included heavy hitters in the science-reform movement, and it appeared in a top journal, Nature Human Behaviour, in November.

“The high replication rate justifies confidence in rigour-enhancing methods to increase the replicability of new discoveries,” concluded the paper, which has been cited more than 70 times, according to Google Scholar. “The reforms are working,” a press release declared, and a news story asked: “What reproducibility crisis?”

 

But now the paper has been retracted, following a monthslong journal investigation into concerns about how it had been designed and written. For starters, it claimed that every aspect of the project had been “preregistered,” referring to the increasingly popular practice of publicly describing plans for a study ahead of time...."

Link:

https://www.chronicle.com/article/this-study-was-hailed-as-a-win-for-science-reform-now-its-being-retracted

From feeds:

Open Access Tracking Project (OATP) » peter.suber's bookmarks

Tags:

oa.new oa.reproducibility oa.retractions oa.psychology oa.paywalled oa.preregistration oa.ssh

Date tagged:

09/25/2024, 10:04

Date published:

09/25/2024, 06:04