Document Type
Journal Article
Publication Title
New Ideas in Psychology
Volume
68
Publisher
Elsevier
School
School of Arts and Humanities
Abstract
Data previously reported from successful replications of 9 famous experiments (Zwaan et al., 2018) were re-analysed. Rather than the null hypothesis significance tests performed in the original study, this study performed a pervasiveness analysis, which examined the number of people in the original samples that demonstrated the effect each experiment is renowned for. Seven of the 9 experiments were shown to exceed the pervasiveness threshold adopted in this study. That is, in each of these 7 experiments, over 80 % of participants demonstrated the target effect, indicating support for Zwaan et al.’s claim that these effects are robust. The remaining 2 experiments (Repetition Priming and Shape Simulation) did not meet this pervasiveness criterion, casting doubt on the reproducibility of these effects. The pervasiveness analysis was demonstrated to be a useful adjunct to traditional forms of analysis because it provides information directly relevant to claims about the reproducibility of psychological effects.
DOI
10.1016/j.newideapsych.2022.100978
Creative Commons License
This work is licensed under a Creative Commons Attribution-Noncommercial-No Derivative Works 4.0 License.
Comments
This is an Authors Accepted Manuscript version of an article published by Elsevier in New Ideas in Psychology. The published version is available at https://doi.org/10.1016/j.newideapsych.2022.100978
Moore, S., Speelman, C. P., & McGann, M. (2023). Pervasiveness of effects in sample-based experimental psychology: A Re-examination of replication data from nine famous psychology experiments. New Ideas in Psychology, 68, article 100978. https://doi.org/10.1016/j.newideapsych.2022.100978