Sparse Quantile Regression

Le-Yu Chen and Sokbae (Simon) Lee

No CWP30/20, CeMMAP working papers from Centre for Microdata Methods and Practice, Institute for Fiscal Studies

Abstract: We consider both l0-penalized and l0-constrained quantile regression estimators. For the l0-penalized estimator, we derive an exponential inequality on the tail probability of excess quantile prediction risk and apply it to obtain non-asymptotic upper bounds on the mean-square parameter and regression function estimation errors. We also derive analogous results for the l0-constrained estimator. The resulting rates of convergence are minimax-optimal and the same as those for l1-penalized estimators. Further, we characterize expected Hamming loss for the l0-penalized estimator. We implement the proposed procedure via mixed integer linear programming and also a more scalable ?rst-order approximation algorithm. We illustrate the ?nite-sample performance of our approach in Monte Carlo experiments and its usefulness in a real data application concerning conformal prediction of infant birth weights (with n ˜ 103 and up to p > 103). In sum, our l0-based method produces a much sparser estimator than the l1-penalized approach without compromising precision.

Date: 2020-06-24
New Economics Papers: this item is included in nep-ore
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.ifs.org.uk/uploads/CWP3020-Sparse-Quantile-Regression-1.pdf (application/pdf)
Our link check indicates that this URL is bad, the error code is: 404 Not Found (https://www.ifs.org.uk/uploads/CWP3020-Sparse-Quantile-Regression-1.pdf [302 Found]--> https://ifs.org.uk/uploads/CWP3020-Sparse-Quantile-Regression-1.pdf)

Related works:
Journal Article: Sparse quantile regression (2023)
Working Paper: Sparse Quantile Regression (2023)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:ifs:cemmap:30/20

Ordering information: This working paper can be ordered from
The Institute for Fiscal Studies 7 Ridgmount Street LONDON WC1E 7AE

Access Statistics for this paper

More papers in CeMMAP working papers from Centre for Microdata Methods and Practice, Institute for Fiscal Studies The Institute for Fiscal Studies 7 Ridgmount Street LONDON WC1E 7AE. Contact information at EDIRC.
Bibliographic data for series maintained by Emma Hyman ().