Re-evaluating RCTs with nightlights - An example from biometric smartcards in India

Merlin Stein

No 152, University of Tübingen Working Papers in Business and Economics from University of Tuebingen, Faculty of Economics and Social Sciences, School of Business and Economics

Abstract: Satellite data and randomized controlled trials (RCTs) are a powerful combination for analyzing causal effects beyond traditional survey-based indicators. The usage of remotely collected data for evaluating RCTs is cost-effective, objective and possible for anyone with treatment assignment data. By re-evaluating one of the largest RCTs - the smartcard intervention of Muralidharan et al. (2016) covering 20 million people - with Indian nighttime luminosity, this paper finds that nightlights as a specific type of satellite data likely often are too noisy to evaluate RCTs. Building upon a post-treatment and a Difference-in-Differences approach, we do not find any statistically significant effects of the biometric smartcards on nightlights, contrasting Muralidharan et al. (2017)'s results of higher income level in treated areas. This can be mainly explained either with the noisiness-caused inability of nightlights to specifically capture economic effects or the absence of an increased economic activity due to a simple redistributive effect of the intervention. The former is more likely when looking at GDP implications of the noisiness in the luminosity data. Per head estimates, sensitivity checks for spillovers, subdistrict-level instead of village-level observations and different time-wise aggregations of nightlight data do not lead to changed results. Although limited with nightlights, nonetheless, the potential for re-evaluating RCTs with satellite data in general is enormous in three ways: (1) For confirming claimed treatment effects, (2) to understand additional impacts and (3) for cost-effectively understanding long-term impacts of interventions. Using daytime imagery for analyzing RCTs is a promising direction for future research.

Keywords: RCT; randomized; nightlight; daylight; satellite; remote-sensing; nighttimeluminosity; India; Census; Muralidharan; state capacity; GDP; nightlights (search for similar items in EconPapers)
JEL-codes: C33 C81 C93 E01 H53 H55 I32 I38 J65 O47 R12 (search for similar items in EconPapers)
Date: 2021
New Economics Papers: this item is included in nep-dev, nep-exp and nep-mac
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.econstor.eu/bitstream/10419/249271/1/1783946598.pdf (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:zbw:tuewef:152

DOI: 10.15496/publikation-63784

Access Statistics for this paper

More papers in University of Tübingen Working Papers in Business and Economics from University of Tuebingen, Faculty of Economics and Social Sciences, School of Business and Economics Contact information at EDIRC.
Bibliographic data for series maintained by ZBW - Leibniz Information Centre for Economics ().