A replication recipe: List your ingredients before you start cooking

Andrew C. Chang

Economics - The Open-Access, Open-Assessment E-Journal (2007-2020), 2018, vol. 12, No 2018-39, 8 pages

Abstract: The author argues that researchers should do replications using preanalysis plans. These plans should specify at least three characteristics that would act as stopping rules for the replicator: (1) how much flowtime the replicator will spend, (2) how much money and effort (working hours) the replicator will spend, and (3) the intended results and the precision of the replication necessary for 'success'. A researcher's replication will be 'successful' according to context-specific criteria in the preanalysis plan. The author also argues that the two biggest drawbacks of preanalysis plans-(1) that they discount unexpected but extraordinary findings and (2) that they make it difficult for researchers to prespecify all possible actions in their decision trees-are less relevant for replications compared with new research. He concludes with describing a preanalysis plan for replicating a paper on housing demand and household formation.

Keywords: data and code files; household formation; housing demand; preanalysis; prespecification; publication bias; replication (search for similar items in EconPapers)
JEL-codes: B41 C80 C81 R21 (search for similar items in EconPapers)
Date: 2018
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (7)

Downloads: (external link)
http://dx.doi.org/10.5018/economics-ejournal.ja.2018-39
https://www.econstor.eu/bitstream/10419/179930/1/1025134567.pdf (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:zbw:ifweej:201839

DOI: 10.5018/economics-ejournal.ja.2018-39

Access Statistics for this article

Economics - The Open-Access, Open-Assessment E-Journal (2007-2020) is currently edited by Dennis J. Snower

More articles in Economics - The Open-Access, Open-Assessment E-Journal (2007-2020) from Kiel Institute for the World Economy (IfW Kiel) Contact information at EDIRC.
Bibliographic data for series maintained by ZBW - Leibniz Information Centre for Economics ().