Evaluating replicability of laboratory experiments in Economics

Colin Camerer (), Anna Dreber, Eskil Forsell, Teck Ho (), Jurgen Huber, Magnus Johannesson, Michael Kirchler, Johan Almenberg, Adam Altmejd, Taizan Chan, Emma Heikensten, Felix Holzmeister, Taisuke Imai, Siri Isaksson, Gideon Nave, Thomas Pfeiffer, Michael Razen and Hang Wu ()

MPRA Paper from University Library of Munich, Germany

Abstract: The reproducibility of scientific findings has been called into question. To contribute data about reproducibility in economics, we replicate 18 studies published in the American Economic Review and the Quarterly Journal of Economics in 2011-2014. All replications follow predefined analysis plans publicly posted prior to the replications, and have a statistical power of at least 90% to detect the original effect size at the 5% significance level. We find a significant effect in the same direction as the original study for 11 replications (61%); on average the replicated effect size is 66% of the original. The reproducibility rate varies between 67% and 78% for four additional reproducibility indicators, including a prediction market measure of peer beliefs.

Keywords: replication; economics; experiment (search for similar items in EconPapers)
JEL-codes: A12 B41 C9 (search for similar items in EconPapers)
Date: 2016-03-03
New Economics Papers: this item is included in nep-cbe, nep-exp and nep-hpe
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (317)

Downloads: (external link)
https://mpra.ub.uni-muenchen.de/75461/1/MPRA_paper_75461.pdf original version (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:pra:mprapa:75461

Access Statistics for this paper

More papers in MPRA Paper from University Library of Munich, Germany Ludwigstraße 33, D-80539 Munich, Germany. Contact information at EDIRC.
Bibliographic data for series maintained by Joachim Winter ().