Is poverty predictable with machine learning? A study of DHS data from Kyrgyzstan

Qing Li, Shuai Yu, Damien Échevin and Min Fan

Socio-Economic Planning Sciences, 2022, vol. 81, issue C

Abstract: A prerequisite for eliminating poverty is to accurately identify and target the households in poverty. While some factors such as asset holdings are well recognized as relevant for assessing and predicting poverty, a priori selected indicators are not sufficient conditions for poverty and the key factors may vary from one case to another. Researchers have begun to apply machine learning algorithms to predict poor households. This paper uses the accuracy of prediction as the standard to study the application of machine learning algorithms. Using the DHS data of 8040 households in Kyrgyzstan, we apply a state-of-the-art algorithm (XGBoost) to explore the full dataset, profiting from the algorithm's ability in handling many variables, and compare the results with the a priori selected variables. We also compare XGBoost with generalized linear model (GLM), the latter being viewed as an approach in between traditional models and modern machine learning algorithms. The results imply that the inclusion of more variables is not necessarily preferable for prediction; a few important variables selected by the algorithms may also perform well. Different algorithms may select different variables as the important ones for prediction. XGBoost performs better than GLM in most cases, and machine learning is useful for variable selection. Additionally, XGBoost is particularly preferable when using a priori variables.

Keywords: Poverty prediction; Machine learning; XGBoost; Generalized linear model (search for similar items in EconPapers)
Date: 2022
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0038012121001877
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:soceps:v:81:y:2022:i:c:s0038012121001877

DOI: 10.1016/j.seps.2021.101195

Access Statistics for this article

Socio-Economic Planning Sciences is currently edited by Barnett R. Parker

More articles in Socio-Economic Planning Sciences from Elsevier
Bibliographic data for series maintained by Catherine Liu ().