Yes, many psychology findings may be “too good to be true” – now what? - Retraction Watch at Retraction Watch

abernard102@gmail.com 2015-08-31

Summary:

" ... Overall, I am not surprised by these findings. We already have quite strong indirect and direct evidence for the relatively high publication and reporting biases in psychology (and other fields), implying that many findings in the psychological literature are too good to be true. Given the smallness of most study samples in social and cognitive psychology and the subtlety of most of the effects that we study, we cannot almost always obtain a significant outcome as the literature appears to suggest. There are surveys in which most psychological researchers admit to making opportunistic decisions in collecting and analyzing data, and in presenting their results. Estimates of the number of completed psychological studies being published are lower than 50%. Many meta-analyses show signs of publication bias (small study effects). And there is recent direct evidence showing that researchers report selectively in psychology and related fields.  And this collective problem is psychologically and socially understandable given that (at least, researchers think that) journals will publish only significant results. This new study corroborates that effects reported in the psychological literature are often inflated, and the most likely culprits are publication bias and reporting biases. Some results appear to replicate just fine, while further research will be needed to determine which original findings were false positives (quite likely given these biases) and which effects turn out to be moderated by some aspect of the study. One effect went from strongly positive in the original to strongly negative in the replication ..."

Link:

http://retractionwatch.com/2015/08/27/yes-many-psychology-findings-may-be-too-good-to-be-true-now-what/

From feeds:

Open Access Tracking Project (OATP) » abernard102@gmail.com

Tags:

oa.new oa.comment oa.psychology oa.data oa.open_science oa.reproducibility oa.ssh

Date tagged:

08/31/2015, 21:05

Date published:

08/31/2015, 17:05