Statistical Model Checking of NetLogo Models

Marco Pangallo, Daniele Giachini and Andrea Vandin

LEM Papers Series from Laboratory of Economics and Management (LEM), Sant'Anna School of Advanced Studies, Pisa, Italy

Abstract: Agent-based models (ABMs) are gaining increasing traction in several domains, due to their ability to represent complex systems that are not easily expressible with classical mathematical models. This expressivity and richness come at a cost: ABMs can typically be analyzed only through simulation, making their analysis challenging. Specifically, when studying the output of ABMs, the analyst is often confronted with practical questions such as: (i) how many independent replications should be run? (ii) how many initial time steps should be discarded as a warm-up? (iii) after the warm-up, how long should the model run? (iv) what are the right parameter values? Analysts usually resort to rules of thumb and experimentation, which lack statistical rigor. This is mainly because addressing these points takes time, and analysts prefer to spend their limited time improving the model. In this paper, we propose a methodology, drawing on the field of Statistical Model Checking, to automate the process and provide guarantees of statistical rigor for ABMs written in NetLogo, one of the most popular ABM platforms. We discuss MultiVeStA, a tool that dramatically reduces the time and human intervention needed to run statistically rigorous checks on ABM outputs, and introduce its integration with NetLogo. Using two ABMs from the NetLogo library, we showcase MultiVeStA's analysis capabilities for NetLogo ABMs, as well as a novel application to statistically rigorous calibration. Our tool-chain makes it immediate to perform statistical checks with NetLogo models, promoting more rigorous and reliable analyses of ABM outputs.

Keywords: NetLogo; MultiVeStA; Transient analysis; Calibration; Warmup estimation; Steady-state analysis (search for similar items in EconPapers)
Date: 2025-09-22
References: Add references at CitEc
Citations:

Downloads: (external link)
http://www.lem.sssup.it/WPLem/files/2025-30.pdf (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:ssa:lemwps:2025/30

Access Statistics for this paper

More papers in LEM Papers Series from Laboratory of Economics and Management (LEM), Sant'Anna School of Advanced Studies, Pisa, Italy Contact information at EDIRC.
Bibliographic data for series maintained by ().