Scalable GWR: A Linear-Time Algorithm for Large-Scale Geographically Weighted Regression with Polynomial Kernels

Daisuke Murakami, Narumasa Tsutsumida, Takahiro Yoshida, Tomoki Nakaya and Binbin Lu

Annals of the American Association of Geographers, 2020, vol. 111, issue 2, 459-480

Abstract: Although a number of studies have developed fast geographically weighted regression (GWR) algorithms for large samples, none of them has achieved linear-time estimation, which is considered a requisite for big data analysis in machine learning, geostatistics, and related domains. Against this backdrop, this study proposes a scalable GWR (ScaGWR) for large data sets. The key improvement is the calibration of the model through a precompression of the matrices and vectors whose size depends on the sample size, prior to the leave-one-out cross-validation, which is the heaviest computational step in conventional GWR. This precompression allows us to run the proposed GWR extension so that its computation time increases linearly with the sample size. With this improvement, the ScaGWR can be calibrated with 1 million observations without parallelization. Moreover, the ScaGWR estimator can be regarded as an empirical Bayesian estimator that is more stable than the conventional GWR estimator. We compare the ScaGWR with the conventional GWR in terms of estimation accuracy and computational efficiency using a Monte Carlo simulation. Then, we apply these methods to a U.S. income analysis. The code for ScaGWR is available in the R package scgwr. The code is embedded into C++ code and implemented in another R package, GWmodel.

Date: 2020
References: Add references at CitEc
Citations: View citations in EconPapers (3)

Downloads: (external link)
http://hdl.handle.net/10.1080/24694452.2020.1774350 (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:taf:raagxx:v:111:y:2020:i:2:p:459-480

Ordering information: This journal article can be ordered from
http://www.tandfonline.com/pricing/journal/raag21

DOI: 10.1080/24694452.2020.1774350

Access Statistics for this article

Annals of the American Association of Geographers is currently edited by Jennifer Cassidento

More articles in Annals of the American Association of Geographers from Taylor & Francis Journals
Bibliographic data for series maintained by Chris Longhurst ().