On data-driven choice of λ in nonparametric Gaussian regression via Propagation–Separation approach

Ewelina Marta Fiebig

Computational Statistics & Data Analysis, 2021, vol. 154, issue C

Abstract: A new procedure is proposed for selecting the input value for the adaptation bandwidth λ in nonparametric Gaussian regression via Propagation–Separation approach. Since λ stands at the bias–variance trade-off of this estimation technique, it is its key tuning parameter. So far, however, apart from theoretical concepts, there exists no approach for a data-driven choice of its input value. This complicates the practical application of the Propagation–Separation method despite its highly desirable statistical properties — it is dimension-free and very well suited for estimation problems where the underlying regression function has sharp discontinuities and large homogeneous regions. The proposed selection method is based on the idea of cross-validation. Therefore, it allows to choose λ in a data-driven way. Its performance is evaluated via simulations. The results are very convincing: Cross-validation is a very transparent selection procedure that provides for each sample a “tailor-made” input value for λ and allows a successful identification of the underlying regression function. As the sample size increases, the accuracy of estimation improves in the sense that the estimates approach the true regression function. In addition, cross-validation accounts for the weighting functions and other parameter values used within the Propagation–Separation method by adjusting λ accordingly, which results in very robust estimates.

Keywords: Propagation–Separation; Adaptive Weights Smoothing; Cross-Validation; Nonparametric estimation; Gaussian regression (search for similar items in EconPapers)
Date: 2021
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S016794732030178X
Full text for ScienceDirect subscribers only.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:csdana:v:154:y:2021:i:c:s016794732030178x

DOI: 10.1016/j.csda.2020.107087

Access Statistics for this article

Computational Statistics & Data Analysis is currently edited by S.P. Azen

More articles in Computational Statistics & Data Analysis from Elsevier
Bibliographic data for series maintained by Catherine Liu ().