Instruments, Randomization, and Learning about Development
Angus Deaton ()
Journal of Economic Literature, 2010, vol. 48, issue 2, 424-55
There is currently much debate about the effectiveness of foreign aid and about what kind of projects can engender economic development. There is skepticism about the ability of econometric analysis to resolve these issues or of development agencies to learn from their own experience. In response, there is increasing use in development economics of randomized controlled trials (RCTs) to accumulate credible knowledge of what works, without overreliance on questionable theory or statistical methods. When RCTs are not possible, the proponents of these methods advocate quasi-randomization through instrumental variable (IV) techniques or natural experiments. I argue that many of these applications are unlikely to recover quantities that are useful for policy or understanding: two key issues are the misunderstanding of exogeneity and the handling of heterogeneity. I illustrate from the literature on aid and growth. Actual randomization faces similar problems as does quasi-randomization, notwithstanding rhetoric to the contrary. I argue that experiments have no special ability to produce more credible knowledge than other methods, and that actual experiments are frequently subject to practical problems that undermine any claims to statistical or epistemic superiority. I illustrate using prominent experiments in development and elsewhere. As with IV methods, RCT-based evaluation of projects, without guidance from an understanding of underlying mechanisms, is unlikely to lead to scientific progress in the understanding of economic development. I welcome recent trends in development experimentation away from the evaluation of projects and toward the evaluation of theoretical mechanisms. (JEL C21, F35, O19)
JEL-codes: C21 F35 O19 (search for similar items in EconPapers)
Note: DOI: 10.1257/jel.48.2.424
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (249) Track citations by RSS feed
Downloads: (external link)
Access to full text is restricted to AEA members and institutional subscribers.
Working Paper: Instruments, randomization, and learning about development (2010)
This item may be available elsewhere in EconPapers: Search for items with the same title.
Export reference: BibTeX
RIS (EndNote, ProCite, RefMan)
Persistent link: https://EconPapers.repec.org/RePEc:aea:jeclit:v:48:y:2010:i:2:p:424-55
Ordering information: This journal article can be ordered from
Access Statistics for this article
Journal of Economic Literature is currently edited by Steven Durlauf
More articles in Journal of Economic Literature from American Economic Association Contact information at EDIRC.
Bibliographic data for series maintained by Michael P. Albert ().