Estimating the accuracy of (local) cross-validation via randomised GCV choices in kernel or smoothing spline regression

Didier Girard

Journal of Nonparametric Statistics, 2010, vol. 22, issue 1, 41-64

Abstract: In nonparametric regression, it is generally crucial to select ‘nearly’ optimal smoothing parameters for which the underlying average squared error (Δ ), with given weights, is ‘nearly’ minimised. The cross-validation (CV) selector or the GCV selector are popular for this task, but it has been observed by many statisticians that these selectors may happen to be ‘not sufficiently’ accurate in some situations. So a practical matter of great importance is the development of reliable estimates of this accuracy. The purpose of this paper is to show that the simulation of the randomised GCV selector or a simple general variant using an ‘augmented-randomised-trace’, can provide useful inferences, like consistent estimates of the standard error in the CV selector or of the expected increase of Δ due to this error. Furthermore, this also provides a tool for constructing more parsimonious curve estimates having almost the same asymptotic justification as the CV estimate, namely with similar increase of Δ up to a given factor. Rigorous proofs are given in the context of one-dimensional kernel regression. Simulated examples, also in this context, illustrate the usefulness of the methodology even at moderate sample sizes. Some direct extensions (for multi-dimensional kernels, equispaced splines) of the theoretical results are outlined. We give heuristics which indicate that the general methodology proposed in this article should be useful in many curve-, surface- or image-estimation problems when using spline-like smoothers.

Date: 2010
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://hdl.handle.net/10.1080/10485250903095820 (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:taf:gnstxx:v:22:y:2010:i:1:p:41-64

Ordering information: This journal article can be ordered from
http://www.tandfonline.com/pricing/journal/GNST20

DOI: 10.1080/10485250903095820

Access Statistics for this article

Journal of Nonparametric Statistics is currently edited by Jun Shao

More articles in Journal of Nonparametric Statistics from Taylor & Francis Journals
Bibliographic data for series maintained by Chris Longhurst ().