Criteria for Linear Model Selection Based on Kullback's Symmetric Divergence

Joseph E. Cavanaugh

Australian & New Zealand Journal of Statistics, 2004, vol. 46, issue 2, 257-274

Abstract: Model selection criteria are frequently developed by constructing estimators of discrepancy measures that assess the disparity between the 'true' model and a fitted approximating model. The Akaike information criterion (AIC) and its variants result from utilizing Kullback's directed divergence as the targeted discrepancy. The directed divergence is an asymmetric measure of separation between two statistical models, meaning that an alternative directed divergence can be obtained by reversing the roles of the two models in the definition of the measure. The sum of the two directed divergences is Kullback's symmetric divergence. In the framework of linear models, a comparison of the two directed divergences reveals an important distinction between the measures. When used to evaluate fitted approximating models that are improperly specified, the directed divergence which serves as the basis for AIC is more sensitive towards detecting overfitted models, whereas its counterpart is more sensitive towards detecting underfitted models. Since the symmetric divergence combines the information in both measures, it functions as a gauge of model disparity which is arguably more balanced than either of its individual components. With this motivation, the paper proposes a new class of criteria for linear model selection based on targeting the symmetric divergence. The criteria can be regarded as analogues of AIC and two of its variants: 'corrected' AIC or AICc and 'modified' AIC or MAIC. The paper examines the selection tendencies of the new criteria in a simulation study and the results indicate that they perform favourably when compared to their AIC analogues.

Date: 2004
References: Add references at CitEc
Citations: View citations in EconPapers (8)

Downloads: (external link)
https://doi.org/10.1111/j.1467-842X.2004.00328.x

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:bla:anzsta:v:46:y:2004:i:2:p:257-274

Ordering information: This journal article can be ordered from
http://www.blackwell ... bs.asp?ref=1369-1473

Access Statistics for this article

Australian & New Zealand Journal of Statistics is currently edited by Chris J. Lloyd, Rob J. Hyndman and Russell B. Millar

More articles in Australian & New Zealand Journal of Statistics from Australian Statistical Publishing Association Inc.
Bibliographic data for series maintained by Wiley Content Delivery ().