Research Registries: Facts, Myths, and Possible Improvements

Eliot Abrams, Jonathan Libgober and John List

Artefactual Field Experiments from The Field Experiments Website

Abstract: The past few decades have ushered in an experimental revolution in economics whereby scholars are now much more likely to generate their own data. While there are virtues associated with this movement, there are concomitant difficulties. Several scientific disciplines, including economics, have launched research registries in an effort to attenuate key inferential issues. This study assesses registries both empirically and theoretically, with a special focus on the AEA registry. We find that over 90% of randomized controlled trials (RCTs) in economics do not register, only 50% of the RCTs that register do so before the intervention begins, and the majority of these preregistrations are not detailed enough to significantly aid inference. Our empirical analysis further shows that using other scientific registries as aspirational examples is misguided, as their perceived success in tackling the main issues is largely a myth. In light of these facts, we advance a simple economic model to explore potential improvements. A key insight from the model is that removal of the (current) option to register completed RCTs could increase the fraction of trials that register. We also argue that linking IRB applications to registrations could further increase registry effectiveness.

Date: 2020
New Economics Papers: this item is included in nep-exp and nep-hpe
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (7)

Downloads: (external link)
http://s3.amazonaws.com/fieldexperiments-papers2/papers/00703.pdf

Related works:
Working Paper: Research Registries: Facts, Myths, and Possible Improvements (2020)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:feb:artefa:00703

Access Statistics for this paper

More papers in Artefactual Field Experiments from The Field Experiments Website
Bibliographic data for series maintained by Francesca Pagnotta ().