On the implications of essential heterogeneity for estimating causal impacts using social experiments

Martin Ravallion

No 5804, Policy Research Working Paper Series from The World Bank

Abstract: Randomized control trials are sometimes used to estimate the aggregate benefit from some policy or program. To address the potential bias from selective take-up, the randomization is used as an instrumental variable for treatment status. Does this (popular) method of impact evaluation help reduce the bias when take-up depends on unobserved gains from take up? Such"essential heterogeneity"is known to invalidate the instrumental variable estimator of mean causal impact, though one still obtains another parameter of interest, namely mean impact amongst those treated. However, if essential heterogeneity is the only problem then the naïve (ordinary least squares) estimator also delivers this parameter; there is no gain from using randomization as an instrumental variable. On allowing the heterogeneity to also alter counterfactual outcomes, the instrumental variable estimator may well be more biased for mean impact than the naïve estimator. Examples are given for various stylized programs, including a training program that attenuates the gains from higher latent ability, an insurance program that compensates for losses from unobserved risky behavior and a microcredit scheme that attenuates the gains from access to other sources of credit. Practitioners need to think carefully about the likely behavioral responses to social experiments in each context.

Keywords: Poverty Monitoring&Analysis; Disease Control&Prevention; Poverty Impact Evaluation; Scientific Research&Science Parks; Science Education (search for similar items in EconPapers)
Date: 2011-09-01
New Economics Papers: this item is included in nep-ecm, nep-ltv and nep-mfd
References: Add references at CitEc
Citations: View citations in EconPapers (11)

Downloads: (external link)
http://www-wds.worldbank.org/external/default/WDSC ... ered/PDF/WPS5804.pdf (application/pdf)

Related works:
Journal Article: On the Implications of Essential Heterogeneity for Estimating Causal Impacts Using Social Experiments (2015)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:wbk:wbrwps:5804

Access Statistics for this paper

More papers in Policy Research Working Paper Series from The World Bank 1818 H Street, N.W., Washington, DC 20433. Contact information at EDIRC.
Bibliographic data for series maintained by Roula I. Yazigi ().