A Preanalysis Plan to Replicate Sixty Economics Research Papers That Worked Half of the Time

Andrew C. Chang and Phillip Li ()

American Economic Review, 2017, vol. 107, issue 5, 60-64

Abstract: We attempted to replicate 67 macroeconomic papers using author-provided data and code files by following a preanalysis plan. Excluding 6 papers that used confidential data, we obtained data and code replication files for 29 of 35 papers (83 percent) that were required to provide such files as a condition of publication, compared to 11 of 26 papers (42 percent) that were not required to provide such files. Also excluding the 2 papers that used software we did not possess, we replicated 29 of 59 papers (49 percent) with assistance from the authors. We conclude with recommendations on improving replication of economics research.

JEL-codes: A14 (search for similar items in EconPapers)
Date: 2017
Note: DOI: 10.1257/aer.p20171034
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (56)

Downloads: (external link)
https://www.aeaweb.org/articles?id=10.1257/aer.p20171034 (application/pdf)
https://www.aeaweb.org/articles/attachments?retrie ... rCpY878I_9Ic0SWk6-kP (application/zip)
Access to full text is restricted to AEA members and institutional subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:aea:aecrev:v:107:y:2017:i:5:p:60-64

Ordering information: This journal article can be ordered from
https://www.aeaweb.org/journals/subscriptions

Access Statistics for this article

American Economic Review is currently edited by Esther Duflo

More articles in American Economic Review from American Economic Association Contact information at EDIRC.
Bibliographic data for series maintained by Michael P. Albert ().