Document Type
Journal Article
Publication Title
New Ideas in Psychology
Volume
68
Publisher
Elsevier
School
School of Arts and Humanities
RAS ID
56535
Abstract
Data previously reported from successful replications of 9 famous experiments (Zwaan et al., 2018) were re-analysed. Rather than the null hypothesis significance tests performed in the original study, this study performed a pervasiveness analysis, which examined the number of people in the original samples that demonstrated the effect each experiment is renowned for. Seven of the 9 experiments were shown to exceed the pervasiveness threshold adopted in this study. That is, in each of these 7 experiments, over 80 % of participants demonstrated the target effect, indicating support for Zwaan et al.’s claim that these effects are robust. The remaining 2 experiments (Repetition Priming and Shape Simulation) did not meet this pervasiveness criterion, casting doubt on the reproducibility of these effects. The pervasiveness analysis was demonstrated to be a useful adjunct to traditional forms of analysis because it provides information directly relevant to claims about the reproducibility of psychological effects.
DOI
10.1016/j.newideapsych.2022.100978
Creative Commons License
This work is licensed under a Creative Commons Attribution-Noncommercial-No Derivative Works 4.0 License.
Comments
This is an Authors Accepted Manuscript version of an article published by Elsevier in New Ideas in Psychology. The published version is available at https://doi.org/10.1016/j.newideapsych.2022.100978
Moore, S., Speelman, C. P., & McGann, M. (2023). Pervasiveness of effects in sample-based experimental psychology: A Re-examination of replication data from nine famous psychology experiments. New Ideas in Psychology, 68, article 100978. https://doi.org/10.1016/j.newideapsych.2022.100978