AIC, Overfitting Principles, and the Boundedness of Moments of Inverse Matrices for Vector Autotregressions and Related Models

David F. Findley and Ching-Zong Wei

Journal of Multivariate Analysis, 2002, vol. 83, issue 2, 415-450

Abstract: In his somewhat informal derivation, Akaike (in "Proceedings of the 2nd International Symposium Information Theory" (C. B. Petrov and F. Csaki, Eds.), pp. 610-624, Academici Kiado, Budapest, 1973) obtained AIC's parameter-count adjustment to the log-likelihood as a bias correction: it yields an asymptotically unbiased estimate of the quantity that measures the average fit of the estimated model to an independent replicate of the data used for estimation. We present the first mathematically complete derivation of an analogous property of AIC for comparing vector autoregressions fit to weakly stationary series. As a preparatory result, we derive a very general "overfitting principle," first formulated in a more limited context in Findley (Ann. Inst. Statist. Math.43, 509-514, 1991), asserting that a natural measure of an estimated model's overfit due to parameter estimation is equal, asymptotically, to a measure of its accuracy loss with independent replicates. A formal principle of parsimony for fitted models is obtained from this, which for nested models, covers the situation in which all models considered are misspecified. To prove these results, we establish a set of general conditions under which, for each [tau][greater-or-equal, slanted]1, the absolute [tau]th moments of the entries of the inverse matrices associated with least squares estimation are bounded for sufficiently large sample sizes.

Keywords: model; selection; misspecified; models; principle; of; parsimony; least; squares; matrices; uniform; Lipschitz; condition; elliptical; distributions (search for similar items in EconPapers)
Date: 2002
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (7)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0047-259X(01)92063-9
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:jmvana:v:83:y:2002:i:2:p:415-450

Ordering information: This journal article can be ordered from
http://www.elsevier.com/wps/find/supportfaq.cws_home/regional
https://shop.elsevie ... _01_ooc_1&version=01

Access Statistics for this article

Journal of Multivariate Analysis is currently edited by de Leeuw, J.

More articles in Journal of Multivariate Analysis from Elsevier
Bibliographic data for series maintained by Catherine Liu ().