A multivariate Jacobi polynomials regression estimator associated with an ANOVA decomposition model

Mohamed Jebalia and Abderrazek Karoui ()
Additional contact information
Mohamed Jebalia: University of Carthage
Abderrazek Karoui: University of Carthage

Metrika: International Journal for Theoretical and Applied Statistics, 2025, vol. 88, issue 3, No 1, 267-310

Abstract: Abstract In this work, we construct a stable and fairly fast estimator for solving multidimensional non-parametric regression problems. The proposed estimator is based on the use of a novel and special system of multivariate Jacobi polynomials that generate a basis for a reduced size of $$d-$$ d - variate finite dimensional polynomials space. An ANOVA decomposition trick has been used for building this space. Also, by using some results from the theory of positive definite random matrices, we show that the proposed estimator is stable under the condition that the i.i.d. $$d-$$ d - dimensional random sampling training points follow a $$d-$$ d - dimensional Beta distribution. In addition, we provide the reader with an estimate for the $$L^2-$$ L 2 - risk error of the estimator. This risk error depends on the $$L^2-$$ L 2 - error of the orthogonal projection error of the regression function over the considered polynomials space. An involved study of this orthogonal projection error is done under the condition that the regression function belongs to a given weighted Sobolev space. Thanks to this novel estimate of the orthogonal projection error, we give the optimal convergence rate of our estimator. Furthermore, we give a regularized extension version of our estimator, that is capable of handling random sampling training vectors drawn according to an unknown multivariate pdf. Moreover, we derive an upper bound for the empirical risk error of this regularized estimator. Finally, we give some numerical simulations that illustrate the various theoretical results of this work. In particular, we provide simulations on a real data that compares the performance of our estimator with some existing and popular NP regression estimators.

Keywords: Non-parametric regression; Jacobi polynomials; Generalized polynomials chaos; ANOVA decomposition; Least squares; Stable regression estimator; Risk error (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s00184-024-00954-4 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:metrik:v:88:y:2025:i:3:d:10.1007_s00184-024-00954-4

Ordering information: This journal article can be ordered from
http://www.springer.com/statistics/journal/184/PS2

DOI: 10.1007/s00184-024-00954-4

Access Statistics for this article

Metrika: International Journal for Theoretical and Applied Statistics is currently edited by U. Kamps and Norbert Henze

More articles in Metrika: International Journal for Theoretical and Applied Statistics from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().