Measuring Simulation-Observation Fit: An Introduction to Ordinal Pattern Analysis

Warren Thorngate () and Bruce Edmonds ()
Additional contact information
Bruce Edmonds: http://cfpm.org

Journal of Artificial Societies and Social Simulation, 2013, vol. 16, issue 2, 4

Abstract: Most traditional strategies of assessing the fit between a simulation's set of predictions (outputs) and a set of relevant observations rely either on visual inspection or squared distances among averages. Here we introduce an alternative goodness-of-fit strategy, Ordinal Pattern Analysis (OPA) that will (we argue) be more appropriate for judging the goodness-of-fit of simulations in many situations. OPA is based on matches and mismatches among the ordinal properties of predictions and observations. It does not require predictions or observations to meet the requirements of interval or ratio measurement scales. In addition, OPA provides a means to assess prediction-observation fits case-by-case prior to aggregation, and to map domains of validity of competing simulations. We provide examples to illustrate how OPA can be employed to assess the ordinal fit and domains of validity of simulations of share prices, crime rates, and happiness ratings. We also provide a computer programme for assisting in the calculation of OPA indices.

Keywords: Ordinal; Goodness-Of-Fit; Statistics; Evidence; Validity; Predictions; Observations (search for similar items in EconPapers)
Date: 2013-03-31
References: Add references at CitEc
Citations: View citations in EconPapers (7)

Downloads: (external link)
https://www.jasss.org/16/2/4/4.pdf (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:jas:jasssj:2012-36-3

Access Statistics for this article

More articles in Journal of Artificial Societies and Social Simulation from Journal of Artificial Societies and Social Simulation
Bibliographic data for series maintained by Francesco Renzini ().