Diaconis–Ylvisaker prior penalized likelihood for / → ∈ (0,1) logistic regression

Philipp Sterzinger and Ioannis Kosmidis

LSE Research Online Documents on Economics from London School of Economics and Political Science, LSE Library

Abstract: Summary: We characterize the behaviour of the maximum Diaconis–Ylvisaker prior penalized likelihood estimator in high-dimensional logistic regression, where the number of covariates is a fraction ∈ (0,1) of the number of observations , as →∞. We construct a rescaled estimator with zero asymptotic aggregate bias, and define adjusted -statistics and rescaled penalized likelihood ratio statistics that exhibit the typical null asymptotic distributions, when the covariates are independent multivariate normal with an arbitrary covariance matrix and the linear predictor has asymptotic variance γ2 . While the maximum likelihood estimate asymptotically exists only for a narrow range of (, γ), the maximum Diaconis–Ylvisaker prior penalized likelihood estimate always exists and can be computed directly using standard maximum likelihood routines. Thus, our asymptotic results extend to (, γ) for which the maximum likelihood framework breaks down, with no additional implementation or computational cost. We study the estimator’s shrinkage properties, compare the proposed estimation and inference procedures with alternatives that also accommodate proportional asymptotics, and formulate a conjecture, supported by strong empirical evidence, that extends our results to models including an intercept parameter. Finally, we propose estimation methods for all unknown constants involved in our procedures and demonstrate the theoretical advances through extensive simulation studies and the analysis of digit recognition data.

JEL-codes: C1 (search for similar items in EconPapers)
Pages: 24 pages
Date: 2026-05-04
References: Add references at CitEc
Citations:

Published in Biometrika, 4, May, 2026, 113(2). ISSN: 0006-3444

Downloads: (external link)
https://researchonline.lse.ac.uk/id/eprint/137326/ Open access version. (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:ehl:lserod:137326

Access Statistics for this paper

More papers in LSE Research Online Documents on Economics from London School of Economics and Political Science, LSE Library LSE Library Portugal Street London, WC2A 2HD, U.K.. Contact information at EDIRC.
Bibliographic data for series maintained by LSERO Manager ().