GeoAI Reproducibility and Replicability: A Computational and Spatial Perspective

Wenwen Li, Chia-Yu Hsu, Sizhe Wang and Peter Kedron

Annals of the American Association of Geographers, 2024, vol. 114, issue 9, 2085-2103

Abstract: GeoAI has emerged as an exciting interdisciplinary research area that combines spatial theories and data with cutting-edge AI models to address geospatial problems in a novel, data-driven manner. Although GeoAI research has flourished in the GIScience literature, its reproducibility and replicability (R&R), fundamental principles that determine the reusability, reliability, and scientific rigor of research findings, have rarely been discussed. This article aims to provide an in-depth analysis of this topic from both computational and spatial perspectives. We first categorize the major goals for reproducing GeoAI research, namely, validation (repeatability), learning and adapting the method for solving a similar or new problem (reproducibility), and examining the generalizability of the research findings (replicability). Each of these goals requires different levels of understanding of GeoAI, as well as different methods to ensure its success. We then discuss the factors that might cause the lack of R&R in GeoAI research, with an emphasis on (1) the selection and use of training data; (2) the uncertainty that resides in the GeoAI model design, training, deployment, and inference processes; and more important (3) the inherent spatial heterogeneity of geospatial data and processes. We use a deep learning-based image analysis task as an example to demonstrate the results’ uncertainty and spatial variance caused by different factors. The findings reiterate the importance of knowledge sharing, as well as the generation of a “replicability map” that incorporates spatial autocorrelation and spatial heterogeneity into consideration in quantifying the spatial replicability of GeoAI research.

Date: 2024
References: Add references at CitEc
Citations:

Downloads: (external link)
http://hdl.handle.net/10.1080/24694452.2024.2373787 (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:taf:raagxx:v:114:y:2024:i:9:p:2085-2103

Ordering information: This journal article can be ordered from
http://www.tandfonline.com/pricing/journal/raag21

DOI: 10.1080/24694452.2024.2373787

Access Statistics for this article

Annals of the American Association of Geographers is currently edited by Jennifer Cassidento

More articles in Annals of the American Association of Geographers from Taylor & Francis Journals
Bibliographic data for series maintained by Chris Longhurst ().