Can we trust shoestring evaluations ?
Martin Ravallion
No 5983, Policy Research Working Paper Series from The World Bank
Abstract:
Many more impact evaluations could be done, and at lower unit cost, if evaluators could avoid the need for baseline data using objective socio-economic surveys and rely instead on retrospective subjective questions on how outcomes have changed, asked post-intervention. But would the results be reliable? This paper tests a rapid-appraisal,"shoestring,"method using subjective recall for welfare changes. The recall data were collected at the end of a full-scale evaluation of a large poor-area development program in China. Qualitative recalls of how living standards have changed are found to provide only weak and biased signals of the changes in consumption as measured from contemporaneous surveys. Importantly, the shoestring method was unable to correct for the selective placement of the program favoring poor villages. The results of this case study are not encouraging for future applications of the shoestring method, although similar tests are needed in other settings.
Keywords: Poverty Monitoring&Analysis; Science Education; Scientific Research&Science Parks; Economic Theory&Research; Housing&Human Habitats (search for similar items in EconPapers)
Date: 2012-03-01
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (1)
Downloads: (external link)
http://www-wds.worldbank.org/external/default/WDSC ... ered/PDF/WPS5983.pdf (application/pdf)
Related works:
Journal Article: Can We Trust Shoestring Evaluations? (2014) 
This item may be available elsewhere in EconPapers: Search for items with the same title.
Export reference: BibTeX
RIS (EndNote, ProCite, RefMan)
HTML/Text
Persistent link: https://EconPapers.repec.org/RePEc:wbk:wbrwps:5983
Access Statistics for this paper
More papers in Policy Research Working Paper Series from The World Bank 1818 H Street, N.W., Washington, DC 20433. Contact information at EDIRC.
Bibliographic data for series maintained by Roula I. Yazigi ().