Orthogonal systems based stable estimator for non parametric regression problems

Asma Ben Saber and Abderrazek Karoui

Communications in Statistics - Theory and Methods, 2025, vol. 54, issue 5, 1299-1327

Abstract: In this work, we study a univariate as well as a multivariate Jacobi polynomial-based estimator for solving the fundamental problem of non parametric (NP) regression. The proposed NP regression estimator aims to approximate a possibly very low regular regression function from the knowledge of its noised values given at some n random sampling points. We first study the univariate version of the proposed estimator, then extend this study to the general multivariate case with random sampling vectors drawn according to an unknown distribution. Our proposed estimator has the advantage of being stable with reasonable time complexity. Moreover, it has an optimal convergence rate under the weak condition that the regression function has a certain low Sobolev smoothness property. Although the proposed estimators are studied under the hypothesis that the random sampling vectors are supported on the d dimensional unit hypercube, by applying trivial transformations, the results of this work are still valid in the more general setting of any d dimensional hyperrectangle. Finally, the theoretical results of this work are illustrated by some numerical simulations on synthetic as well as real datasets.

Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://hdl.handle.net/10.1080/03610926.2024.2333339 (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:taf:lstaxx:v:54:y:2025:i:5:p:1299-1327

Ordering information: This journal article can be ordered from
http://www.tandfonline.com/pricing/journal/lsta20

DOI: 10.1080/03610926.2024.2333339

Access Statistics for this article

Communications in Statistics - Theory and Methods is currently edited by Debbie Iscoe

More articles in Communications in Statistics - Theory and Methods from Taylor & Francis Journals
Bibliographic data for series maintained by Chris Longhurst ().