A New Method to Evaluate Simulation Models: The Calibration Profile (CP) Algorithm

Romain Reuillon (), Clara Schmitt (), Ricardo De Aldama () and Jean-Baptiste Mouret ()

Journal of Artificial Societies and Social Simulation, 2015, vol. 18, issue 1, 12

Abstract: Models of social systems generally contain free parameters that cannot be evaluated directly from data. A calibration phase is therefore necessary to assess the capacity of the model to produce the expected dynamics. However, despite the high computational cost of this calibration it doesn't produce a global picture of the relationship between the parameter space and the behaviour space of the model. The Calibration Profile (CP) algorithm is an innovative method extending the concept of automated calibration processes. It computes a profile that depicts the effect of each single parameter on the model behaviour, independently from the others. A 2-dimensional graph is thus produced exposing the impact of the parameter under study on the capacity of the model to produce expected dynamics. The first part of this paper is devoted to the formal description of the CP algorithm. In the second part,we apply it to an agent based geographical model (SimpopLocal). The analysis of the results brings to light novel insights on the model.

Keywords: Calibration Profile; Model Evaluation (search for similar items in EconPapers)
Date: 2015-01-31
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.jasss.org/18/1/12/12.pdf (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:jas:jasssj:2014-43-2

Access Statistics for this article

More articles in Journal of Artificial Societies and Social Simulation from Journal of Artificial Societies and Social Simulation
Bibliographic data for series maintained by Francesco Renzini ().