Plug-in regularized estimation of high dimensional parameters in nonlinear semiparametric models

Victor Chernozhukov, Denis Nekipelov, Vira Semenova and Vasilis Syrgkanis
Additional contact information
Denis Nekipelov: Institute for Fiscal Studies and Berkeley
Vira Semenova: Institute for Fiscal Studies and Harvard
Vasilis Syrgkanis: Institute for Fiscal Studies

No CWP41/18, CeMMAP working papers from Centre for Microdata Methods and Practice, Institute for Fiscal Studies

Abstract: We develop a theory for estimation of a high-dimensional sparse parameter ?? defi ned as a minimizer of a population loss function LD(??,g0) which, in addition to ??, depends on a, potentially infi nite dimensional, nuisance parameter g0. Our approach is based on estimating ?? via an l1-regularized minimization of a sample analog of Ls(??,g), plugging in a fi rst-stage estimate g, computed on a hold-out sample. We defi ne a population loss to be (Neyman) orthogonal if the gradient of the loss with respect to ??, has pathwise derivative with respect to g equal to zero, when evaluated at the true parameter and nuisance component. We show that orthogonality implies a second-order impact of the fi rst stage nuisance error on the second stage target parameter estimate. Our approach applies to both convex and non-convex losses, albeit the latter case requires a small adaptation of our method with a preliminary estimation step of the target parameter. Our result enables oracle convergence rates for ?? under assumptions on the first stage rates, typically of the order of n1/4. We show how such an orthogonal loss can be constructed via a novel orthogonalization process for a general model de fined by conditional moment restrictions. We apply our theory to high-dimensional versions of standard estimation problems in statistics and econometrics, such as: estimation of conditional moment models with missing data, estimation of structural utilities in games of incomplete information and estimation of treatment effects in regression models with non-linear link functions.

Date: 2018-07-04
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (4)

Downloads: (external link)
https://www.ifs.org.uk/uploads/cemmap/wps/CWP411818.pdf (application/pdf)
Our link check indicates that this URL is bad, the error code is: 404 Not Found (https://www.ifs.org.uk/uploads/cemmap/wps/CWP411818.pdf [302 Found]--> https://ifs.org.uk/uploads/cemmap/wps/CWP411818.pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:ifs:cemmap:41/18

Ordering information: This working paper can be ordered from
The Institute for Fiscal Studies 7 Ridgmount Street LONDON WC1E 7AE

Access Statistics for this paper

More papers in CeMMAP working papers from Centre for Microdata Methods and Practice, Institute for Fiscal Studies The Institute for Fiscal Studies 7 Ridgmount Street LONDON WC1E 7AE. Contact information at EDIRC.
Bibliographic data for series maintained by Emma Hyman ().