Can We Trust Shoestring Evaluations?

Martin Ravallion

The World Bank Economic Review, 2014, vol. 28, issue 3, 413-431

Abstract: Many more impact evaluations could be done, and at lower unit cost, if evaluators could avoid the need for baseline data using objective socio-economic surveys and rely instead on retrospective subjective questions on how outcomes have changed, asked post-intervention. But would the results be reliable? This paper tests a rapid-appraisal, "shoestring" method using subjective recall for welfare changes. The recall data were collected at the end of a full-scale evaluation of a large World Bank supported poor-area development program in China. Qualitative recalls on how living standards have changed are found to provide only weak and biased signals of the changes in consumption as measured from contemporaneous surveys. Importantly, the shoestring method was unable to correct for the selective placement of the program favoring poor villages. The results of this case study are not encouraging for future applications of the shoestring method, although similar tests are needed in other settings.

Date: 2014
References: Add references at CitEc
Citations: View citations in EconPapers (4)

Downloads: (external link)
http://hdl.handle.net/10.1093/wber/lht016 (application/pdf)
Access to full text is restricted to subscribers.

Related works:
Working Paper: Can we trust shoestring evaluations ? (2012)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:oup:wbecrv:v:28:y:2014:i:3:p:413-431.

Ordering information: This journal article can be ordered from
https://academic.oup.com/journals

Access Statistics for this article

The World Bank Economic Review is currently edited by Eric Edmonds and Nina Pavcnik

More articles in The World Bank Economic Review from World Bank Oxford University Press, Great Clarendon Street, Oxford OX2 6DP, UK. Contact information at EDIRC.
Bibliographic data for series maintained by Oxford University Press ().