Towards the study of least squares Estimators with convex penalty

Pierre C. Bellec (), Guillaume Lecué () and Alexandre Tsybakov ()
Additional contact information
Pierre C. Bellec: Rutgers University
Guillaume Lecué: CREST;ENSAE
Alexandre Tsybakov: CREST;ENSAE

No 2017-23, Working Papers from Center for Research in Economics and Statistics

Abstract: Penalized least squares estimation is a popular technique in high-dimensional statistics. It includes such methods as the LASSO, the group LASSO, and the nuclear norm penalized least squares. The existing theory of these methods is not fully satisfying since it allows one to prove oracle inequalities with fixed high probability only for the estimators depending on this probability. Furthermore, the control of compatibility factors appearing in the oracle bounds is often not explicit. Some very recent developments suggest that the theory of oracle inequalities can be revised in an improved way. In this paper, we provide an overview of ideas and tools leading to such an improved theory. We show that, along with overcoming the disadvantages mentioned above, the methodology extends to the hilbertian framework and it applies to a large class of convex penalties. This paper is partly expository. In particular, we provide adapted proofs of some results from other recent work.

Pages: 20 pages
Date: 2017-07-07
New Economics Papers: this item is included in nep-ecm
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
http://crest.science/RePEc/wpstorage/2017-23.pdf CREST working paper version (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:crs:wpaper:2017-23

Access Statistics for this paper

More papers in Working Papers from Center for Research in Economics and Statistics Contact information at EDIRC.
Bibliographic data for series maintained by Secretariat General () and Murielle Jules Maintainer-Email : murielle.jules@ensae.Fr.