Incentives and the replication crisis in social sciences: A critical review of open science practices

Loukas Balafoutas, Jeremy Celse, Alexandros Karakostas and Nicholas Umashev

Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), 2025, vol. 114, issue C

Abstract: The replication crisis in the social sciences has revealed systemic issues undermining the credibility of research findings, primarily driven by misaligned incentives that encourage questionable research practices (QRPs). This paper offers a comprehensive and critical review of recent empirical evidence on the effectiveness of Open Science initiatives—such as replication studies, reproducibility efforts, pre-registrations, and registered reports—in addressing the root causes of the replication crisis. Building upon and extending prior reviews, we integrate recent theoretical models from economics with empirical findings across several social science disciplines to assess how these practices impact research integrity. Our review demonstrates that while measures like pre-registration and data sharing have advanced transparency, they often fall short in mitigating QRPs due to persistent incentive misalignments. In contrast, registered reports and megastudies show greater promise by fundamentally reshaping the incentive structure, shifting the focus from producing statistically significant results to emphasizing methodological rigor and meaningful research questions. We argue that realigning incentives is crucial for fostering a culture of integrity and offer policy recommendations involving key stakeholders—including authors, journals, editors, reviewers, and institutions—to promote practices that enhance research reliability and credibility across the social sciences.

Keywords: Replication crisis; Preregistration; Registered reports; Reproducibility; Publish or perish (search for similar items in EconPapers)
JEL-codes: A11 B49 C18 I23 (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S2214804324001642
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:soceco:v:114:y:2025:i:c:s2214804324001642

DOI: 10.1016/j.socec.2024.102327

Access Statistics for this article

Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics) is currently edited by Pablo Brañas Garza

More articles in Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics) from Elsevier
Bibliographic data for series maintained by Catherine Liu ().