Signal extraction approach for sparse multivariate response regression

Ruiyan Luo and Xin Qi

Journal of Multivariate Analysis, 2017, vol. 153, issue C, 83-97

Abstract: In this paper, we consider multivariate response regression models with high dimensional predictor variables. One way to estimate the coefficient matrix is through its decomposition. Among various decomposition of the coefficient matrix, we focus on the decomposition which leads to the best approximation to the signal part in the response vector given any rank. Finding this decomposition is equivalent to performing a principal component analysis for the signal. Given any rank, this decomposition has nearly the smallest expected prediction error among all decompositions of the coefficient matrix with the same rank. To estimate the decomposition, we solve a penalized generalized eigenvalue problem followed by a least squares procedure. In the high-dimensional setting, allowing a general covariance structure for the noise vector, we establish the oracle inequalities for the estimates. Simulation studies and application to real data show that the proposed method has good prediction performance and is efficient in dimension reduction for various models.

Keywords: Multivariate regression; High dimensional predictors; Signal extraction; Dimension reduction; Best lower rank approximation; Oracle inequalities (search for similar items in EconPapers)
Date: 2017
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0047259X16300884
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:jmvana:v:153:y:2017:i:c:p:83-97

Ordering information: This journal article can be ordered from
http://www.elsevier.com/wps/find/supportfaq.cws_home/regional
https://shop.elsevie ... _01_ooc_1&version=01

DOI: 10.1016/j.jmva.2016.09.005

Access Statistics for this article

Journal of Multivariate Analysis is currently edited by de Leeuw, J.

More articles in Journal of Multivariate Analysis from Elsevier
Bibliographic data for series maintained by Catherine Liu ().