Support estimation and sign recovery in high‐dimensional heteroscedastic mean regression

Philipp Hermann and Hajo Holzmann

Scandinavian Journal of Statistics, 2025, vol. 52, issue 2, 805-839

Abstract: A current strand of research in high‐dimensional statistics deals with robustifying the methodology with respect to deviations from the pervasive light‐tail assumptions. In this article, we consider a linear mean regression model with random design and potentially heteroscedastic, heavy‐tailed errors, and investigate support estimation and sign recovery. We use a strictly convex, smooth variant of the Huber loss function with tuning parameters depending on the parameters of the problem, as well as the adaptive LASSO penalty for computational efficiency. For the resulting estimator, we show sign‐consistency and optimal rates of convergence in the ℓ∞$$ {\ell}_{\infty } $$ norm as in the homoscedastic, light‐tailed setting. In our simulations, we also connect to the recent literature on variable selection with the thresholded LASSO and false discovery rate control using knockoffs and indicate the relevance of the Donoho‐Tanner transition curve for variable selection. The simulations illustrate the favorable numerical performance of the proposed methodology.

Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
https://doi.org/10.1111/sjos.12772

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:bla:scjsta:v:52:y:2025:i:2:p:805-839

Ordering information: This journal article can be ordered from
http://www.blackwell ... bs.asp?ref=0303-6898

Access Statistics for this article

Scandinavian Journal of Statistics is currently edited by ÿrnulf Borgan and Bo Lindqvist

More articles in Scandinavian Journal of Statistics from Danish Society for Theoretical Statistics, Finnish Statistical Society, Norwegian Statistical Association, Swedish Statistical Association
Bibliographic data for series maintained by Wiley Content Delivery ().