Measuring Poverty and Inequality with Reduced Data: A Machine Learning Approach Using Nigerian Household Data

Vanesa Jordá and Miguel Niño-Zarazúa
Additional contact information
Vanesa Jordá: Department of Economics, Cantabria University, Avda. de los Castros, 56. 39005 Santander, Spain
Miguel Niño-Zarazúa: Department of Economics, SOAS University of London, Thornhaugh Street, Russell Square, London WC1H 0XG, UK

No 275, Working Papers from Department of Economics, SOAS University of London, UK

Abstract: Reliable measurement of income and consumption is essential for monitoring poverty and inequality in low- and middle-income countries, yet full household surveys are costly and difficult to implement regularly. This paper examines whether reduced survey instruments can preserve key distributional information. We apply Random Forest Recursive Feature Elimination (RF-RFE) to the 2018/19 Nigeria General Household Survey-Panel to identify the income sources, consumption categories and household characteristics that best classify individuals within the welfare distribution. The analysis focuses on three outcomes: poverty status, location in the quintile distribution and position relative to the Gini-based inequality line. The survey's post-planting and post-harvest periods allow us to assess performance under different seasonal contexts. Results show that RF-RFE achieves strong classification accuracy with few predictors. For consumption, poverty status and inequality-line position are accurately predicted using a small set of expenditure categories, while quintile classification reaches about 80 percent accuracy for seasonal consumption and 60-65 percent for annual consumption predicted from a single seasonal visit. For income, poverty status reaches around 90 percent accuracy with five predictors, and inequality-line position is largely captured by labour earnings. The findings suggest that machine-learning methods can help improve survey design and reduce data requirements while retaining much of the distributional information needed to measure and monitor poverty and inequality.

Keywords: consumption measurement; poverty; inequality; Random Forests; household surveys; Nigeria (search for similar items in EconPapers)
JEL-codes: C38 C55 D31 I32 O55 (search for similar items in EconPapers)
Pages: 14374
References: Add references at CitEc
Citations:

Downloads: (external link)
https://www.soas.ac.uk/sites/default/files/2026-06/economics-wp275.pdf (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:soa:wpaper:275

Access Statistics for this paper

More papers in Working Papers from Department of Economics, SOAS University of London, UK Contact information at EDIRC.
Bibliographic data for series maintained by Chandni Dwarkasing ().