Metamodels for Evaluating, Calibrating and Applying Agent-Based Models: A Review

Bruno Pietzsch (), Sebastian Fiedler (), Kai G. Mertens (), Markus Richter (), Cédric Scherer (), Kirana Widyastuti (), Marie-Christin Wimmler (), Liubov Zakharova () and Uta Berger ()
Additional contact information
Bruno Pietzsch: https://tu-dresden.de/bu/umwelt/forst/ww/bsa/die-professur/staff/academic/bruno-pietzsch
Sebastian Fiedler: https://www.sbfiedler.de
Kai G. Mertens: https://www.tuhh.de/maccs/team/research-associates/kai-g-mertens-m-sc.html
Cédric Scherer: https://cedricscherer.netlify.com/
Kirana Widyastuti: https://tu-dresden.de/bu/umwelt/forst/ww/bsa/die-professur/staff/academic/kirana-widyastuti
Marie-Christin Wimmler: https://tu-dresden.de/bu/umwelt/forst/ww/bsa/die-professur/staff/academic/marie-wimmler
Uta Berger: https://tu-dresden.de/bu/umwelt/forst/ww/bsa/die-professur/uta-berger?set_language=en

Journal of Artificial Societies and Social Simulation, 2020, vol. 23, issue 2, 9

Abstract: The recent advancement of agent-based modeling is characterized by higher demands on the parameterization, evaluation and documentation of these computationally expensive models. Accordingly, there is also a growing request for "easy to go" applications just mimicking the input-output behavior of such models. Metamodels are being increasingly used for these tasks. In this paper, we provide an overview of common metamodel types and the purposes of their usage in an agent-based modeling context. To guide modelers in the selection and application of metamodels for their own needs, we further assessed their implementation effort and performance. We performed a literature research in January 2019 using four different databases. Five different terms paraphrasing metamodels (approximation, emulator, meta-model, metamodel and surrogate) were used to capture the whole range of relevant literature in all disciplines. All metamodel applications found were then categorized into specific metamodel types and rated by different junior and senior researches from varying disciplines (including forest sciences, landscape ecology, or economics) regarding the implementation effort and performance. Specifically, we captured the metamodel performance according to (i) the consideration of uncertainties, (ii) the suitability assessment provided by the authors for the particular purpose, and (iii) the number of valuation criteria provided for suitability assessment. We selected 40 distinct metamodel applications from studies published in peer-reviewed journals from 2005 to 2019. These were used for the sensitivity analysis, calibration and upscaling of agent-based models, as well to mimic their prediction for different scenarios. This review provides information about the most applicable metamodel types for each purpose and forms a first guidance for the implementation and validation of metamodels for agent-based models.

Keywords: Individual-Based Model; Surrogate Model; Emulator; Calibration; Sensitivity Analysis; Review (search for similar items in EconPapers)
Date: 2020-03-31
References: Add references at CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
https://www.jasss.org/23/2/9/9.pdf (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:jas:jasssj:2018-90-2

Access Statistics for this article

More articles in Journal of Artificial Societies and Social Simulation from Journal of Artificial Societies and Social Simulation
Bibliographic data for series maintained by Francesco Renzini ().