Structured variable selection via prior-induced hierarchical penalty functions

Tso-Jung Yen and Yu-Min Yen

Computational Statistics & Data Analysis, 2016, vol. 96, issue C, 87-103

Abstract: The paper studies a grouped variable selection problem in a linear regression setting by proposing a hierarchical penalty function to model collective behavior of the regression coefficients. This hierarchical penalty function consists of two levels. At the top level, it models the group effect of covariates by introducing an index function on the event that the l2-norm of the corresponding regression coefficients is not equal to zero. At the bottom level, it models the individual effect of a covariate with an index function on the event that the corresponding regression coefficient is not equal to zero. Under this hierarchical penalty function, model estimation can be conducted by applying an iteration-based numerical procedure to solve a sequence of modified optimization problems. Simulation study shows that the proposed estimator performs relatively well when the number of covariates exceeds the sample size, and when both the true and false covariates are included in the same group. Theoretical analysis suggests that the l2 estimation error of the proposed estimator can achieve a good upper bound if some regularity conditions are satisfied.

Keywords: Group sparsity; Spike and slab priors; Log-sum approximation to the l0-norm; Majorization–minimization algorithms; Alternating direction method of multipliers (search for similar items in EconPapers)
Date: 2016
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0167947315002662
Full text for ScienceDirect subscribers only.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:csdana:v:96:y:2016:i:c:p:87-103

DOI: 10.1016/j.csda.2015.10.011

Access Statistics for this article

Computational Statistics & Data Analysis is currently edited by S.P. Azen

More articles in Computational Statistics & Data Analysis from Elsevier
Bibliographic data for series maintained by Catherine Liu ().