Geographical-XGBoost: a new ensemble model for spatially local regression based on gradient-boosted trees

George Grekousis ()
Additional contact information
George Grekousis: Sun Yat-sen University

Journal of Geographical Systems, 2025, vol. 27, issue 2, No 2, 169-195

Abstract: Abstract XGBoost is a widely used machine learning method known for exhibiting high accuracies in regression and classification tasks. Current efforts to create spatial versions of XGBoost do not alter the original XGBoost algorithm; nor do they implement any geographical modification. Here, we fill these gaps by introducing Geographical-XGBoost (G-XGBoost), which extends XGBoost in multiple ways. First, G-XGBoost creates local models by assigning spatial weights linked directly to the model’s accuracy by focusing on the samples that cause the most error. Second, it applies ensemble architecture, by combining the global and local models, for training, validation, and prediction, which improves model accuracy. Third, G-XGBoost calculates local feature importance using spatial weights, something not proposed so far. We evaluate G-XGBoost on six benchmark datasets against three global regression models (Ordinary Least Squares, Random Forests, and XGBoost) and three spatially local regression models (Geographically Weighted Regression, Geographical Random Forests, and Geographically Weighted Random Forests). G-XGBoost outperforms all existing models improving R2 by 17.44% and mean absolute error by 17.42%, on bootstrapped mean values. G-XGBoost is also an exploratory tool as it analyzes how feature importance varies in space, contributing thus to the need for interpretable and explainable AI, and therefore, it can further advance spatial machine learning application to geographical studies.

Keywords: Spatial machine learning; Spatially local regression; XGBoost; Benchmark datasets (search for similar items in EconPapers)
JEL-codes: C14 C18 C21 C63 (search for similar items in EconPapers)
Date: 2025
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s10109-025-00465-4 Abstract (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:kap:jgeosy:v:27:y:2025:i:2:d:10.1007_s10109-025-00465-4

Ordering information: This journal article can be ordered from
http://www.springer. ... ce/journal/10109/PS2

DOI: 10.1007/s10109-025-00465-4

Access Statistics for this article

Journal of Geographical Systems is currently edited by Manfred M. Fischer and Antonio Páez

More articles in Journal of Geographical Systems from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().