Psychology results evaporate upon further review
Surprising reports, findings with marginal statistical significance least likely to be reproduced, study concludes
By Bruce Bower
Psychologists have recently bemoaned a trend for provocative and sometimes highly publicized findings that vanish in repeat experiments. A large, collaborative project has now put an unsettling, and contested, number on the extent of that problem.
Only 35 of 97 reports of statistically significant results published in three major psychology journals in 2008 could be replicated, a group led by psychologist Brian Nosek of the University of Virginia in Charlottesville reports in the Aug. 28 Science. Nosek is executive director of the Center for Open Science, which coordinated 270 researchers involved in the replication project.