High-dimensional integrative analysis with homogeneity and sparsity recovery

Xinfeng Yang, Xiaodong Yan and Jian Huang

Journal of Multivariate Analysis, 2019, vol. 174, issue C

Abstract: This paper studies integrative analysis of multiple units in the context of high-dimensional linear regression. We consider the case where a fraction of the covariates have different effects on the responses across various units, e.g., some coefficients are the same for all the units, while others have grouping structures. We propose a least squares approach, combined with a difference penalty term to penalize the difference between any two units’ coefficients of the same covariate for identifying latent grouping structure, as well as a common sparsity penalty to detect important covariates. Without the need to know the grouping structure of every variable across the data units and the sparsity construction within the variables, the proposed double penalized procedure can automatically identify the covariates with heterogeneous effects, covariates with homogeneous effects, and recover the sparsity, the grouping structures of the heterogeneous covariates, and provide estimates of all regression coefficients simultaneously. We proceed the alternating direction method of multipliers algorithm (ADMM) through effectively utilizing the storage and reading of the datasets, and demonstrate the convergence of the proposed procedure. We show that the proposed estimator enjoys the oracle property. Simulation studies demonstrate the good performance of the new method with finite samples, and a real data example is provided for illustration.

Keywords: Concave penalization; Heterogeneity; Homogeneity; Massive data; Oracle property; Sparsity (search for similar items in EconPapers)
Date: 2019
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0047259X18305165
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:jmvana:v:174:y:2019:i:c:s0047259x18305165

Ordering information: This journal article can be ordered from
http://www.elsevier.com/wps/find/supportfaq.cws_home/regional
https://shop.elsevie ... _01_ooc_1&version=01

DOI: 10.1016/j.jmva.2019.06.007

Access Statistics for this article

Journal of Multivariate Analysis is currently edited by de Leeuw, J.

More articles in Journal of Multivariate Analysis from Elsevier
Bibliographic data for series maintained by Catherine Liu ().