Macroeconomic simulation comparison with a multivariate extension of the Markov Information Criterion

Sylvain Barde

Studies in Economics from School of Economics, University of Kent

Abstract: Comparison of macroeconomic simulation models, particularly agent-based models (ABMs), with more traditional approaches such as VAR and DSGE models has long been identified as an important yet problematic issue in the literature. This is due to the fact that many such simulations have been developed following the great recession with a clear aim to inform policy, yet the methodological tools required for validating these models on empirical data are still in their infancy. The paper aims to address this issue by developing and testing a comparison framework for macroeconomic simulation models based on a multivariate extension of the Markov Information Criterion (MIC) originally developed in Barde (2017). The MIC is designed to measure the informational distance between a set of models and some empirical data by mapping the simulated data to the markov transition matrix of the underlying data generating process, and is proven to perform optimally (i.e. the measurement is unbiased in expectation) for all models reducible to a markov process. As a result, not only can the MIC provide an accurate measure of distance solely on the basis of simulated data, but it can do it for a very wide class of data generating processes. The paper first presents the strategies adopted to address the computational challenges that arise from extending the methodology to multivariate settings and validates the extension on VAR and DGSE models. The paper then carries out a comparison of the benchmark ABM of Caiani et al. (2016) and the DGSE framework of Smets and Wouters (2007), which to our knowledge, is the first direct comparison between a macroeconomic ABM and a DGSE model.

Keywords: Model comparison; Agent-based models; Validation methods (search for similar items in EconPapers)
JEL-codes: B41 C15 C52 C63 (search for similar items in EconPapers)
Date: 2019-06
New Economics Papers: this item is included in nep-cmp, nep-ecm, nep-hme, nep-mac and nep-ore
References: Add references at CitEc
Citations:

Downloads: (external link)
https://www.kent.ac.uk/economics/repec/1908.pdf (application/pdf)

Related works:
Journal Article: Macroeconomic simulation comparison with a multivariate extension of the Markov information criterion (2020)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:ukc:ukcedp:1908

Ordering information: This working paper can be ordered from

Access Statistics for this paper

More papers in Studies in Economics from School of Economics, University of Kent School of Economics, University of Kent, Canterbury, Kent, CT2 7FS.
Bibliographic data for series maintained by Dr Anirban Mitra ().