A replication recipe: List your ingredients before you start cooking

Andrew C. Chang

No 2017-74, Economics Discussion Papers from Kiel Institute for the World Economy (IfW Kiel)

Abstract: The author argues that researchers should do replications using preanalysis plans. These plans should specify at least three characteristics: (1) how much flowtime the researchers will spend, (2) how much money and effort (working hours) the researchers will spend, and (3) the intended results and the precision of the replication necessary for "success". A researcher's replication will be "successful" according to context-specific criteria in the preanalysis plan. The author also argues that the two biggest drawbacks of preanalysis plans-(1) that they discount unexpected but extraordinary findings and (2) that they make it difficult for researchers to prespecify all possible actions in their decision trees-are less relevant for replications compared with new research. The author concludes with describing a preanalysis plan for replicating a paper on housing demand and household formation.

Keywords: Data and code files; household formation; housing demand; preanalysis; prespecification; publication bias; replication (search for similar items in EconPapers)
JEL-codes: B41 C80 C81 R21 (search for similar items in EconPapers)
Date: 2017
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (2)

Downloads: (external link)
http://www.economics-ejournal.org/economics/discussionpapers/2017-74
https://www.econstor.eu/bitstream/10419/169133/1/898637708.pdf (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:zbw:ifwedp:201774

Access Statistics for this paper

More papers in Economics Discussion Papers from Kiel Institute for the World Economy (IfW Kiel) Contact information at EDIRC.
Bibliographic data for series maintained by ZBW - Leibniz Information Centre for Economics ().