Which tests not witch hunts: A diagnostic approach for conducting replication research

Annette Brown and Benjamin Wood

Economics - The Open-Access, Open-Assessment E-Journal (2007-2020), 2018, vol. 12, No 2018-53, 26 pages

Abstract: Replication research can be used to explore original study results that researchers consider questionable, but it should also be a tool for reinforcing the credibility of results that are important to policies and programs. The challenge is to design a replication plan open to both supporting the original findings and uncovering potential problems. The purpose of this paper is to provide replication researchers with an objective list of checks or tests to consider when planning a replication study. The authors present tips for diagnostic replication exercises in four groups: validity of assumptions, data transformations, estimation methods, and heterogeneous impacts. For each group, the authors present an introduction to the issues, a list of replication tests and checks, some examples of how these checks are employed in replication studies of development impact evaluations, and a set of resources that provide statistical and econometric details. The authors also provide a list of don'ts for how to conduct and report replication research.

Keywords: replication; validation; data transformation; estimation methods; reanalysis; theory of change; assumptions (search for similar items in EconPapers)
JEL-codes: A20 B41 C10 (search for similar items in EconPapers)
Date: 2018
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (2)

Downloads: (external link)
http://dx.doi.org/10.5018/economics-ejournal.ja.2018-53
https://www.econstor.eu/bitstream/10419/181452/1/1029195676.pdf (application/pdf)

Related works:
Working Paper: Which tests not witch hunts: a diagnostic approach for conducting replication research (2017)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:zbw:ifweej:201853

DOI: 10.5018/economics-ejournal.ja.2018-53

Access Statistics for this article

Economics - The Open-Access, Open-Assessment E-Journal (2007-2020) is currently edited by Dennis J. Snower

More articles in Economics - The Open-Access, Open-Assessment E-Journal (2007-2020) from Kiel Institute for the World Economy (IfW Kiel) Contact information at EDIRC.
Bibliographic data for series maintained by ZBW - Leibniz Information Centre for Economics ().