On some stable linear functional regression estimators based on random projections

Asma Ben Saber and Abderrazek Karoui ()
Additional contact information
Asma Ben Saber: Department of Mathematics
Abderrazek Karoui: Department of Mathematics

Statistical Papers, 2024, vol. 65, issue 7, No 6, 4147-4178

Abstract: Abstract In this work, we develop two stable estimators for solving linear functional regression problems. It is well known that such a problem is an ill-posed stochastic inverse problem. Hence, a special interest has to be devoted to the stability issue in the design of an estimator for solving such a problem. Our proposed estimators are based on combining a stable least-squares technique and a random projection of the slope function $$\beta _0(\cdot )\in L^2(J),$$ β 0 ( · ) ∈ L 2 ( J ) , where J is a compact interval. Moreover, these estimators have the advantage of having a fairly good convergence rate with reasonable computational load, since the involved random projections are generally performed over a fairly small dimensional subspace of $$L^2(J).$$ L 2 ( J ) . More precisely, the first estimator is given as a least-squares solution of a regularized minimization problem over a finite dimensional subspace of $$L^2(J).$$ L 2 ( J ) . In particular, we give an upper bound for the empirical risk error as well as the convergence rate of this estimator. The second proposed stable LFR estimator is based on combining the least-squares technique with a dyadic decomposition of the i.i.d. samples of the stochastic process, associated with the LFR model. In particular, we provide an $$L^2$$ L 2 -risk error of this second LFR estimator. Finally, we provide some numerical simulations on synthetic as well as on real data that illustrate the results of this work. These results indicate that our proposed estimators are competitive with some existing and popular LFR estimators.

Keywords: Linear functional regression; Penalized least-squares; Stochastic process; Random projection; Stable estimator; Empirical risk error; $$L^2$$ L 2 -risk error (search for similar items in EconPapers)
Date: 2024
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s00362-024-01554-0 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:stpapr:v:65:y:2024:i:7:d:10.1007_s00362-024-01554-0

Ordering information: This journal article can be ordered from
http://www.springer. ... business/journal/362

DOI: 10.1007/s00362-024-01554-0

Access Statistics for this article

Statistical Papers is currently edited by C. Müller, W. Krämer and W.G. Müller

More articles in Statistical Papers from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().