New Ideas in Psychology
School of Arts and Humanities
Data previously reported from successful replications of 9 famous experiments (Zwaan et al., 2018) were re-analysed. Rather than the null hypothesis significance tests performed in the original study, this study performed a pervasiveness analysis, which examined the number of people in the original samples that demonstrated the effect each experiment is renowned for. Seven of the 9 experiments were shown to exceed the pervasiveness threshold adopted in this study. That is, in each of these 7 experiments, over 80 % of participants demonstrated the target effect, indicating support for Zwaan et al.’s claim that these effects are robust. The remaining 2 experiments (Repetition Priming and Shape Simulation) did not meet this pervasiveness criterion, casting doubt on the reproducibility of these effects. The pervasiveness analysis was demonstrated to be a useful adjunct to traditional forms of analysis because it provides information directly relevant to claims about the reproducibility of psychological effects.
Creative Commons License
This work is licensed under a Creative Commons Attribution-Noncommercial-No Derivative Works 4.0 License.
Available for download on Friday, January 31, 2025