An information theoretic criterion for empirical validation of simulation models
Econometrics and Statistics, 2018, vol. 5, issue C, 83-106
Simulated models suffer intrinsically from validation and comparison problems. The choice of a suitable indicator quantifying the distance between the model and the data is pivotal to model selection. An information theoretic criterion, called GSL-div, is introduced to measure how closely models’ synthetic output replicates the properties of observable time series without the need to resort to the likelihood function or to impose stationarity requirements. The indicator is sufficiently general to be applied to any model able to simulate or predict time series data, from simple univariate models to more complex objects including Agent-Based Models. When a set of models is given, a simple function of the L-divergence is used to select the candidate producing distributions of patterns that are closest to those observed in the data. The proposed approach is illustrated through three examples of increasing complexity where the GSL-div is used to discriminate among a variety of competing models. Results are compared to those obtained employing alternative measures of model’s fit. The GSL-div is found to perform, in the vast majority of cases, better than the alternatives.
Keywords: Simulations; Empirical validation; Model selection; Time series; Agent Based Models (search for similar items in EconPapers)
References: View references in EconPapers View complete reference list from CitEc
Citations View citations in EconPapers (2) Track citations by RSS feed
Downloads: (external link)
Full text for ScienceDirect subscribers only. Contains open access articles
This item may be available elsewhere in EconPapers: Search for items with the same title.
Export reference: BibTeX
RIS (EndNote, ProCite, RefMan)
Persistent link: https://EconPapers.repec.org/RePEc:eee:ecosta:v:5:y:2018:i:c:p:83-106
Access Statistics for this article
Econometrics and Statistics is currently edited by E.J. Kontoghiorghes, H. Van Dijk and A.M. Colubi
More articles in Econometrics and Statistics from Elsevier
Bibliographic data for series maintained by Dana Niculescu ().