A Practical, Universal, Information Criterion over Nth Order Markov Processes

Sylvain Barde

Studies in Economics from School of Economics, University of Kent

Abstract: The recent increase in the breath of computational methodologies has been matched with a corresponding increase in the difficulty of comparing the relative explanatory power of models from different methodological lineages. In order to help address this problem a universal information criterion (UIC) is developed that is analogous to the Akaike information criterion (AIC) in its theoretical derivation and yet can be applied to any model able to generate simulated or predicted data, regardless of its methodology. Both the AIC and proposed UIC rely on the Kullback-Leibler (KL) distance between model predictions and real data as a measure of prediction accuracy. Instead of using the maximum likelihood approach like the AIC, the proposed UIC relies instead on the literal interpretation of the KL distance as the inefficiency of compressing real data using modelled probabilities, and therefore uses the output of a universal compression algorithm to obtain an estimate of the KL distance. Several Monte Carlo tests are carried out in order to (a) confirm the performance of the algorithm and (b) evaluate the ability of the UIC to identify the true data-generating process from a set of alternative models.

Keywords: AIC; Minimum description length; Model selection (search for similar items in EconPapers)
JEL-codes: B41 C15 C52 C63 (search for similar items in EconPapers)
Date: 2015-01
New Economics Papers: this item is included in nep-ecm
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (17)

Downloads: (external link)
https://www.kent.ac.uk/economics/repec/1504.pdf (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:ukc:ukcedp:1504

Ordering information: This working paper can be ordered from

Access Statistics for this paper

More papers in Studies in Economics from School of Economics, University of Kent School of Economics, University of Kent, Canterbury, Kent, CT2 7FS.
Bibliographic data for series maintained by Dr Anirban Mitra ().