Bias-Aware Inference in Regularized Regression Models

Timothy Armstrong, Michal Kolesár and Soonwoo Kwon
Additional contact information
Michal Kolesár: Princeton University
Soonwoo Kwon: Yale University

Working Papers from Princeton University. Economics Department.

Abstract: We consider inference on a regression coefficient under a constraint on the magnitude of the control coefficients. We show that a class of estimators based on an auxiliary regularized regression of the regressor of interest on control variables exactly solves a tradeoff between worst-case bias and variance. We derive "bias-aware" confidence intervals (CIs) based on these estimators, which take into account possible bias when forming the critical value. We show that these estimators and CIs are near-optimal in finite samples for mean squared error and CI length. Our finite-sample results are based on an idealized setting with normal regression errors with known homoskedastic variance, and we provide conditions for asymptotic validity with unknown and possibly heteroskedastic error distribution. Focusing on the case where the constraint on the magnitude of control coefficients is based on an `p norm (p ≥ 1), we derive rates of convergence for optimal estimators and CIs under high-dimensional asymptotics that allow the number of regressors to increase more quickly than the number of observations.

Keywords: Regularized; regression (search for similar items in EconPapers)
JEL-codes: C20 (search for similar items in EconPapers)
Date: 2020-12
New Economics Papers: this item is included in nep-ban and nep-ore
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.princeton.edu/~mkolesar/papers/regularized_regression.pdf

Related works:
Working Paper: Bias-Aware Inference in Regularized Regression Models (2023)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:pri:econom:2020-2

Access Statistics for this paper

More papers in Working Papers from Princeton University. Economics Department. Contact information at EDIRC.
Bibliographic data for series maintained by Bobray Bordelon ().