Measuring the Measurement Error: A Method to Qualitatively Validate Survey Data

Christopher Blattman, Julian C. Jamison, Tricia Koroknay-Palicz, Katherine Rodrigues and Margaret Sheridan

No 21447, NBER Working Papers from National Bureau of Economic Research, Inc

Abstract: Field experiments rely heavily on self-reported data, but subjects may misreport behaviors, especially sensitive ones such as crime. If treatment influences survey responses, it biases experimental estimates. We develop a validation technique that uses intensive qualitative work to assess survey measurement error. Subjects were assigned to receive cash, therapy, both, or neither. According to survey responses, receiving both treatments dramatically reduced crime and other sensitive behaviors. Local researchers spent several days with a random subsample of subjects following their endline surveys, building trust and seeking verbal confirmation of six behaviors: theft, drug use, homelessness, gambling, and two expenditures. This validation suggests that subjects in the control and cash only groups underreported sensitive behaviors and expenditures in the survey relative to the other treatment arms. We bound survey-based treatment effects estimates, and find the impacts of cash and therapy on crime may be larger than suggested by surveys alone.

JEL-codes: C81 C93 I32 K4 O1 (search for similar items in EconPapers)
Date: 2015-08
New Economics Papers: this item is included in nep-exp
Note: DEV
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (3)

Published as Blattman, Christopher & Jamison, Julian & Koroknay-Palicz, Tricia & Rodrigues, Katherine & Sheridan, Margaret, 2016. "Measuring the measurement error: A method to qualitatively validate survey data," Journal of Development Economics, Elsevier, vol. 120(C), pages 99-112.

Downloads: (external link)
http://www.nber.org/papers/w21447.pdf (application/pdf)

Related works:
Journal Article: Measuring the measurement error: A method to qualitatively validate survey data (2016)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:nbr:nberwo:21447

Ordering information: This working paper can be ordered from
http://www.nber.org/papers/w21447

Access Statistics for this paper

More papers in NBER Working Papers from National Bureau of Economic Research, Inc National Bureau of Economic Research, 1050 Massachusetts Avenue Cambridge, MA 02138, U.S.A.. Contact information at EDIRC.
Bibliographic data for series maintained by ().