Nonparametric multiple regression by projection on non-compactly supported bases

Florian Dussap ()
Additional contact information
Florian Dussap: Université Paris Cité

Annals of the Institute of Statistical Mathematics, 2023, vol. 75, issue 5, No 2, 771 pages

Abstract: Abstract We study the nonparametric regression estimation problem with a random design in $${\mathbb{R}}^{p}$$ R p with $$p\ge 2$$ p ≥ 2 . We do so by using a projection estimator obtained by least squares minimization. Our contribution is to consider non-compact estimation domains in $${\mathbb {R}}^{p}$$ R p , on which we recover the function, and to provide a theoretical study of the risk of the estimator relative to a norm weighted by the distribution of the design. We propose a model selection procedure in which the model collection is random and takes into account the discrepancy between the empirical norm and the norm associated with the distribution of design. We prove that the resulting estimator automatically optimizes the bias-variance trade-off in both norms, and we illustrate the numerical performance of our procedure on simulated data.

Keywords: Nonparametric estimation; Nonparametric regression; Hermite basis; Model selection (search for similar items in EconPapers)
Date: 2023
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s10463-022-00863-1 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:aistmt:v:75:y:2023:i:5:d:10.1007_s10463-022-00863-1

Ordering information: This journal article can be ordered from
http://www.springer. ... cs/journal/10463/PS2

DOI: 10.1007/s10463-022-00863-1

Access Statistics for this article

Annals of the Institute of Statistical Mathematics is currently edited by Tomoyuki Higuchi

More articles in Annals of the Institute of Statistical Mathematics from Springer, The Institute of Statistical Mathematics
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().