Principal component analysis constrained by layered simple structures

Naoto Yamashita ()
Additional contact information
Naoto Yamashita: Kansai University

Advances in Data Analysis and Classification, 2023, vol. 17, issue 2, No 4, 347-367

Abstract: Abstract The paper proposes a procedure for principal component analysis called layered principal component analysis (LPCA) to produce a simple and interpretable loading matrix. The novelty of LPCA is that a loading matrix is constrained as a sum of matrices with simple structures called layers, and the resulting simplicity of the LPCA solution is controlled by how many layers are used. LPCA is a generalization of disjoint PCA proposed as reported by Ferrara (in: Giommi (ed) Topics in theoretical and applied statistics, Springer, Cham 2016). The number of layers controls the balance of simplicity and the fit to the data, and the user can choose the desired level of simplicity between the most restrictive but simplest case with a single layer or multiple layers with better fit to the data. The optimal number of layers is specified in terms of explained variance and two information criteria. Two simulation studies were conducted to evaluate how accurately the LPCA procedure recovers the true parameter values. The results showed that LPCA was effective for parameter recovery. The paper presents three examples of LPCA applied to real data, which show the potential of LPCA for producing simple and interpretable loading matrices.

Keywords: Principal component analysis; Interpretability; Majorization; Multivariate data analysis; Least squares estimation; Alternating least squares; Perfect cluster structure; 62H25; 62H12; 62P15 (search for similar items in EconPapers)
Date: 2023
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s11634-022-00503-9 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:advdac:v:17:y:2023:i:2:d:10.1007_s11634-022-00503-9

Ordering information: This journal article can be ordered from
http://www.springer. ... ds/journal/11634/PS2

DOI: 10.1007/s11634-022-00503-9

Access Statistics for this article

Advances in Data Analysis and Classification is currently edited by H.-H. Bock, W. Gaul, A. Okada, M. Vichi and C. Weihs

More articles in Advances in Data Analysis and Classification from Springer, German Classification Society - Gesellschaft für Klassifikation (GfKl), Japanese Classification Society (JCS), Classification and Data Analysis Group of the Italian Statistical Society (CLADAG), International Federation of Classification Societies (IFCS)
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().