Uniform post selection inference for LAD regression and other z-estimation problems

Alexandre Belloni, Victor Chernozhukov and Kengo Kato

No 74/13, CeMMAP working papers from Institute for Fiscal Studies

Abstract: We develop uniformly valid confidence regions for regression coefficients in a high-dimensional sparse least absolute deviation/median regression model. The setting is one where the number of regressors p could be large in comparison to the sample size n, but only s ≪ n of them are needed to accurately describe the regression function. Our new methods are based on the instrumental median regression estimator that assembles the optimal estimating equation from the output of the post ℓ1-penalized median regression and post ℓ1-penalized least squares in an auxiliary equation. The estimating equation is immunized against non-regular estimation of nuisance part of the median regression function, in the sense of Neyman. We establish that in a homoscedastic regression model, the instrumental median regression estimator of a single regression coefficient is asymptotically root-n normal uniformly with respect to the underlying sparse model. The resulting confidence regions are valid uniformly with respect to the underlying model. We illustrate the value of uniformity with Monte-Carlo experiments which demonstrate that standard/naive post-selection inference breaks down over large parts of the parameter space, and the proposed method does not. We then generalize our method to the case where p1 ≫ n regression coefficients are of interest in a non-smooth Z-estimation framework with approximately sparse nuisance functions, containing median regression with a single target regression coefficient as a very special case. We construct simultaneous confidence bands on all p1 coefficients, and establish their uniform validity over the underlying approximately sparse model.

Date: 2013-12-30
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.cemmap.ac.uk/wp-content/uploads/2020/08/CWP7413.pdf (application/pdf)

Related works:
Working Paper: Uniform Post Selection Inference for LAD Regression and Other Z-estimation problems (2020)
Working Paper: Uniform post selection inference for LAD regression and other Z-estimation problems (2014)
Working Paper: Uniform post selection inference for LAD regression and other Z-estimation problems (2014)
Working Paper: Uniform post selection inference for LAD regression and other z-estimation problems (2013)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:azt:cemmap:74/13

DOI: 10.1920/wp.cem.2013.7413

Access Statistics for this paper

More papers in CeMMAP working papers from Institute for Fiscal Studies Contact information at EDIRC.
Bibliographic data for series maintained by Dermot Watson ().