Generalization in the Tropics: Development policy, randomized controlled trials, and external validity
Jörg Peters,
Jörg Langbein and
Gareth Roberts
No 716, Ruhr Economic Papers from RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen
Abstract:
When properly implemented, Randomized Controlled Trials (RCT) achieve a high degree of internal validity. Yet, if an RCT is to inform policy, it is critical to establish external validity. This paper systematically reviews all RCTs conducted in developing countries and published in leading economic journals between 2009 and 2014 with respect to how they deal with external validity. Following Duflo, Glennerster, and Kremer (2008), the hazards to external validity we scrutinize are Hawthorne effects, general equilibrium effects, specific sample problems, and special care in treatment provision. Based on a set of objective indicators, we find that the majority of published RCTs does not discuss these hazards and many do not provide the necessary information to assess potential problems. The paper calls for including external validity dimensions in a more systematic reporting on the results of RCTs. This may create incentives to avoid overgeneralizing findings and help policy makers to interpret results appropriately.
Keywords: policy evaluation; systematic review; internal validity; external validity; randomized controlled trials (search for similar items in EconPapers)
JEL-codes: C83 C93 (search for similar items in EconPapers)
Date: 2017
New Economics Papers: this item is included in nep-dev and nep-exp
References: Add references at CitEc
Citations:
Downloads: (external link)
https://www.econstor.eu/bitstream/10419/170702/1/100071845X.pdf (application/pdf)
Related works:
Journal Article: Generalization in the Tropics – Development Policy, Randomized Controlled Trials, and External Validity (2018)
This item may be available elsewhere in EconPapers: Search for items with the same title.
Export reference: BibTeX
RIS (EndNote, ProCite, RefMan)
HTML/Text
Persistent link: https://EconPapers.repec.org/RePEc:zbw:rwirep:716
DOI: 10.4419/86788835
Access Statistics for this paper
More papers in Ruhr Economic Papers from RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen Contact information at EDIRC.
Bibliographic data for series maintained by ZBW - Leibniz Information Centre for Economics (econstor@zbw-workspace.eu).