A framework for evaluating reproducibility and replicability in economics

Anna Dreber and Magnus Johannesson

Economic Inquiry, 2025, vol. 63, issue 2, 338-356

Abstract: We propose a framework for evaluating reproducibility and replicability in economics. Reproducibility is defined as testing if the results of an original study can be reproduced using the same data and replicability is defined as testing if the results of an original study hold in new data. We further divide reproducibility and replicability studies into five types: computational reproducibility, recreate reproducibility, robustness reproducibility, direct replicability and conceptual replicability. In addition to this typology we propose indicators to measure the degree of reproducibility and replicability in both individual studies and for a group of studies.

Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
https://doi.org/10.1111/ecin.13244

Related works:
Working Paper: A framework for evaluating reproducibility and replicability in economics (2023)
Working Paper: A framework for evaluating reproducibility and replicability in economics (2023)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:bla:ecinqu:v:63:y:2025:i:2:p:338-356

Ordering information: This journal article can be ordered from
https://ordering.onl ... s.aspx?ref=1465-7295

Access Statistics for this article

Economic Inquiry is currently edited by Tim Salmon

More articles in Economic Inquiry from Western Economic Association International Contact information at EDIRC.
Bibliographic data for series maintained by Wiley Content Delivery ().