Measuring the measurement error: A method to qualitatively validate survey data
Christopher Blattman (),
Katherine Rodrigues and
Journal of Development Economics, 2016, vol. 120, issue C, 99-112
Empirical social science relies heavily on self-reported data, but subjects may misreport behaviors, especially sensitive ones such as crime or drug abuse. If a treatment influences survey misreporting, it biases causal estimates. We develop a validation technique that uses intensive qualitative work to assess survey misreporting and pilot it in a field experiment where subjects were assigned to receive cash, therapy, both, or neither. According to survey responses, both treatments reduced crime and other sensitive behaviors. Local researchers spent several days with a random subsample of subjects after surveys, building trust and obtaining verbal confirmation of four sensitive behaviors and two expenditures. In this instance, validation showed survey underreporting of most sensitive behaviors was low and uncorrelated with treatment, while expenditures were under reported in the survey across all arms, but especially in the control group. We use these data to develop measurement error bounds on treatment effects estimated from surveys.
Keywords: Measurement error; Survey data; Validation; Field experiments; Liberia; Crime; Drugs; Risky behaviors (search for similar items in EconPapers)
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (4) Track citations by RSS feed
Downloads: (external link)
Full text for ScienceDirect subscribers only
Working Paper: Measuring the Measurement Error: A Method to Qualitatively Validate Survey Data (2015)
This item may be available elsewhere in EconPapers: Search for items with the same title.
Export reference: BibTeX
RIS (EndNote, ProCite, RefMan)
Persistent link: https://EconPapers.repec.org/RePEc:eee:deveco:v:120:y:2016:i:c:p:99-112
Access Statistics for this article
Journal of Development Economics is currently edited by M. R. Rosenzweig
More articles in Journal of Development Economics from Elsevier
Bibliographic data for series maintained by Haili He ().