On the Optimality of Prediction‐based Selection Criteria and the Convergence Rates of Estimators

Naomi Altman and Christian Léger

Journal of the Royal Statistical Society Series B, 1997, vol. 59, issue 1, 205-216

Abstract: Several estimators of squared prediction error have been suggested for use in model and bandwidth selection problems. Among these are cross‐validation, generalized cross‐validation and a number of related techniques based on the residual sum of squares. For many situations with squared error loss, e.g. nonparametric smoothing, these estimators have been shown to be asymptotically optimal in the sense that in large samples the estimator minimizing the selection criterion also minimizes squared error loss. However, cross‐validation is known not to be asymptotically optimal for some `easy' location problems. We consider selection criteria based on estimators of squared prediction risk for choosing between location estimators. We show that criteria based on adjusted residual sum of squares are not asymptotically optimal for choosing between asymptotically normal location estimators that converge at rate n1/2but are when the rate of convergence is slower. We also show that leave‐one‐out cross‐validation is not asymptotically optimal for choosing between √n‐differentiable statistics but leave‐d‐out cross‐validation is optimal when d∞ at the appropriate rate.

Date: 1997
References: Add references at CitEc
Citations:

Downloads: (external link)
https://doi.org/10.1111/1467-9868.00064

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:bla:jorssb:v:59:y:1997:i:1:p:205-216

Ordering information: This journal article can be ordered from
http://ordering.onli ... 1111/(ISSN)1467-9868

Access Statistics for this article

Journal of the Royal Statistical Society Series B is currently edited by P. Fryzlewicz and I. Van Keilegom

More articles in Journal of the Royal Statistical Society Series B from Royal Statistical Society Contact information at EDIRC.
Bibliographic data for series maintained by Wiley Content Delivery ().