Penalized estimation for non-identifiable models

Junichiro Yoshida () and Nakahiro Yoshida
Additional contact information
Junichiro Yoshida: University of Tokyo
Nakahiro Yoshida: University of Tokyo

Annals of the Institute of Statistical Mathematics, 2024, vol. 76, issue 5, No 2, 765-796

Abstract: Abstract We derive asymptotic properties of penalized estimators for singular models for which identifiability may break and the true parameter values can lie on the boundary of the parameter space. Selection consistency of the estimators is also validated. The problem that the true values lie on the boundary is solved by our previous results applicable to singular models, besides, penalized estimation and non-ergodic statistics. To overcome non-identifiability, we consider a suitable penalty such as the non-convex Bridge and the adaptive Lasso that stabilize the asymptotic behavior of the estimator and shrink inactive parameters. Then the estimator converges to one of the most parsimonious values among all the true values. The oracle property can also be obtained even if likelihood ratio tests for model selection are labor intensive due to singularity of models. Examples are: a superposition of parametric proportional hazard models and a counting process having intensity with multicollinear covariates.

Keywords: Quasi-likelihood; Penalized likelihood; Boundary; Non-identifiability; Variable selection; Superposed process; Multicollinearity; Proportional hazard model (search for similar items in EconPapers)
Date: 2024
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s10463-024-00905-w Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:aistmt:v:76:y:2024:i:5:d:10.1007_s10463-024-00905-w

Ordering information: This journal article can be ordered from
http://www.springer. ... cs/journal/10463/PS2

DOI: 10.1007/s10463-024-00905-w

Access Statistics for this article

Annals of the Institute of Statistical Mathematics is currently edited by Tomoyuki Higuchi

More articles in Annals of the Institute of Statistical Mathematics from Springer, The Institute of Statistical Mathematics
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().