Improving Estimates of Mean Welfare and Uncertainty in Developing Countries

Joshua David Merfeld and David Newhouse

No 10348, Policy Research Working Paper Series from The World Bank

Abstract: Reliable estimates of economic welfare for small areas are valuable inputs into the design and evaluation of development policies. This paper compares the accuracy of point estimates and confidence intervals for small area estimates of wealth and poverty derived from four different prediction methods: linear mixed models, Cubist regression, extreme gradient boosting, and boosted regression forests. The evaluation draws samples from unit-level household census data from four developing countries, combines them with publicly and globally available geospatial indicators to generate small area estimates, and evaluates these estimates against aggregates calculated using the full census. Predictions of wealth are evaluated in four countries and poverty in one. All three machine learning methods outperform the traditional linear mixed model, with extreme gradient boosting and boosted regression forests generally outperforming the other alternatives. The proposed residual bootstrap procedure reliably estimates confidence intervals for the machine learning estimators, with estimated coverage rates across simulations falling between 94 and 97 percent. These results demonstrate that predictions obtained using tree-based gradient boosting with a random effect block bootstrap generate more accurate point and uncertainty estimates than prevailing methods for generating small area welfare estimates.

Date: 2023-03-08
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
http://documents.worldbank.org/curated/en/09941350 ... 5e1087657f2c9ec9.pdf (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:wbk:wbrwps:10348

Access Statistics for this paper

More papers in Policy Research Working Paper Series from The World Bank 1818 H Street, N.W., Washington, DC 20433. Contact information at EDIRC.
Bibliographic data for series maintained by Roula I. Yazigi ().