‘One Size Does Not Fit All’: A Roadmap of Purpose-Driven Mixed-Method Pathways for Sensitivity Analysis of Agent-Based Models

Arika Ligmann-Zielinska (), Peer-Olaf Siebers (), Nicholas R Magliocca (), Dawn Parker, Volker Grimm (), Jing Du (), Martin Cenek (), Viktoriia Radchuk (), Nazia N. Arbab (), Sheng Li (), Uta Berger (), Rajiv Paudel (), Derek T. Robinson (), Piotr Jankowski (), Li An () and Xinyue Ye ()
Additional contact information
Arika Ligmann-Zielinska: http://geo.msu.edu/people/ligmann-zielinska-arika/
Peer-Olaf Siebers: https://people.cs.nott.ac.uk/pszps/
Nicholas R Magliocca: https://heima.ua.edu/people.html
Volker Grimm: https://www.ufz.de/index.php?de=36522
Jing Du: https://faculty.eng.ufl.edu/ericdu/
Martin Cenek: http://sites.google.com/view/cenek
Viktoriia Radchuk: http://www.izw-berlin.de/dr-radchuk-viktoriia.html
Nazia N. Arbab: http://deenr.rutgers.edu/acadstafflist.html
Uta Berger: https://tu-dresden.de/bu/umwelt/forst/ww/bsa/die-professur/uta-berger?set_language=en
Rajiv Paudel: http://geo.msu.edu/people/paudel-rajiv/
Derek T. Robinson: https://uwaterloo.ca/geography-environmental-management/people-profiles/derek-t-robinson
Piotr Jankowski: http://geography.sdsu.edu/People/Faculty/jankowski.php
Li An: http://complexities.org/An/
Xinyue Ye: https://informatics.njit.edu/faculty/xye

Journal of Artificial Societies and Social Simulation, 2020, vol. 23, issue 1, 6

Abstract: Designing, implementing, and applying agent-based models (ABMs) requires a structured approach, part of which is a comprehensive analysis of the output to input variability in the form of uncertainty and sensitivity analysis (SA). The objective of this paper is to assist in choosing, for a given ABM, the most appropriate methods of SA. We argue that no single SA method fits all ABMs and that different methods of SA should be used based on the overarching purpose of the model. For example, abstract exploratory models that focus on a deeper understanding of the target system and its properties are fed with only the most critical data representing patterns or stylized facts. For them, simple SA methods may be sufficient in capturing the dependencies between the output-input spaces. In contrast, applied models used in scenario and policy-analysis are usually more complex and data-rich because a higher level of realism is required. Here the choice of a more sophisticated SA may be critical in establishing the robustness of the results before the model (or its results) can be passed on to end-users. Accordingly, we present a roadmap that guides ABM developers through the process of performing SA that best fits the purpose of their ABM. This roadmap covers a wide range of ABM applications and advocates for the routine use of global methods that capture input interactions and are, therefore, mandatory if scientists want to recognize all sensitivities. As part of this roadmap, we report on frontier SA methods emerging in recent years: a) handling temporal and spatial outputs, b) using the whole output distribution of a result rather than its variance, c) looking at topological relationships between input data points rather than their values, and d) looking into the ABM black box – finding behavioral primitives and using them to study complex system characteristics like regime shifts, tipping points, and condensation versus dissipation of collective system behavior.

Keywords: Sensitivity Analysis; Agent-Based Model; Individual-Based Model; Review (search for similar items in EconPapers)
Date: 2020-01-31
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (5)

Downloads: (external link)
https://www.jasss.org/23/1/6/6.pdf (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:jas:jasssj:2019-63-2

Access Statistics for this article

More articles in Journal of Artificial Societies and Social Simulation from Journal of Artificial Societies and Social Simulation
Bibliographic data for series maintained by Francesco Renzini ().