An information theoretic criterion for empirical validation of simulation models

Francesco Lamperti

Econometrics and Statistics, 2018, vol. 5, issue C, 83-106

Abstract: Simulated models suffer intrinsically from validation and comparison problems. The choice of a suitable indicator quantifying the distance between the model and the data is pivotal to model selection. An information theoretic criterion, called GSL-div, is introduced to measure how closely models’ synthetic output replicates the properties of observable time series without the need to resort to the likelihood function or to impose stationarity requirements. The indicator is sufficiently general to be applied to any model able to simulate or predict time series data, from simple univariate models to more complex objects including Agent-Based Models. When a set of models is given, a simple function of the L-divergence is used to select the candidate producing distributions of patterns that are closest to those observed in the data. The proposed approach is illustrated through three examples of increasing complexity where the GSL-div is used to discriminate among a variety of competing models. Results are compared to those obtained employing alternative measures of model’s fit. The GSL-div is found to perform, in the vast majority of cases, better than the alternatives.

Keywords: Simulations; Empirical validation; Model selection; Time series; Agent Based Models (search for similar items in EconPapers)
Date: 2018
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (41)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S2452306217300084
Full text for ScienceDirect subscribers only. Contains open access articles

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:ecosta:v:5:y:2018:i:c:p:83-106

DOI: 10.1016/j.ecosta.2017.01.006

Access Statistics for this article

Econometrics and Statistics is currently edited by E.J. Kontoghiorghes, H. Van Dijk and A.M. Colubi

More articles in Econometrics and Statistics from Elsevier
Bibliographic data for series maintained by Catherine Liu ().