Repository logo
 

Is replication possible without fidelity?

Accepted version
Peer-reviewed

Loading...
Thumbnail Image

Type

Article

Change log

Authors

Ellefson, Michelle R  ORCID logo  https://orcid.org/0000-0003-0407-9767
Oppenheimer, Daniel M  ORCID logo  https://orcid.org/0000-0002-2363-4220

Abstract

Failure of replication attempts in experimental psychology might extend beyond p-hacking, publication bias or hidden moderators; reductions in experimental power can be caused by violations of fidelity to a set of experimental protocols. In this article, we run a series of simulations to systematically explore how manipulating fidelity influences effect size. We find statistical patterns that mimic those found in ManyLabs style replications and meta-analyses, suggesting that fidelity violations are present in many replications attempts in psychology. Scholars in intervention science, medicine, and education have developed methods of improving and measuring fidelity, and as replication becomes more mainstream in psychology, the field would benefit from adopting such approaches as well. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Description

Keywords

Humans, Research Design, Reproducibility of Results, Publication Bias

Journal Title

Psychol Methods

Conference Name

Journal ISSN

1082-989X
1939-1463

Volume Title

Publisher

American Psychological Association (APA)
Relationships
Is supplemented by: