Sufficient dimension reduction via random‐partitions for the large‐p‐small‐n problem

Hung Hung and Su‐Yun Huang

Biometrics, 2019, vol. 75, issue 1, 245-255

Abstract: Sufficient dimension reduction (SDR) continues to be an active field of research. When estimating the central subspace (CS), inverse regression based SDR methods involve solving a generalized eigenvalue problem, which can be problematic under the large‐p‐small‐n situation. In recent years, new techniques have emerged in numerical linear algebra, called randomized algorithms or random sketching, for high‐dimensional and large scale problems. To overcome the large‐p‐small‐n SDR problem, we combine the idea of statistical inference with random sketching to propose a new SDR method, called integrated random‐partition SDR (iRP‐SDR). Our method consists of the following three steps: (i) Randomly partition the covariates into subsets to construct an envelope subspace with low dimension. (ii) Obtain a sketch of the CS by applying a conventional SDR method within the constructed envelope subspace. (iii) Repeat the above two steps many times and integrate these multiple sketches to form the final estimate of the CS. After describing the details of these steps, the asymptotic properties of iRP‐SDR are established. Unlike existing methods, iRP‐SDR does not involve the determination of the structural dimension until the last stage, which makes it more adaptive to a high‐dimensional setting. The advantageous performance of iRP‐SDR is demonstrated via simulation studies and a practical example analyzing EEG data.

Date: 2019
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://doi.org/10.1111/biom.12926

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:bla:biomet:v:75:y:2019:i:1:p:245-255

Ordering information: This journal article can be ordered from
http://www.blackwell ... bs.asp?ref=0006-341X

Access Statistics for this article

More articles in Biometrics from The International Biometric Society
Bibliographic data for series maintained by Wiley Content Delivery ().