Speeding up the convergence of the alternating least squares algorithm using vector $$\varepsilon $$ ε acceleration and restarting for nonlinear principal component analysis

Masahiro Kuroda (), Yuichi Mori and Masaya Iizuka
Additional contact information
Masahiro Kuroda: Okayama University of Science
Yuichi Mori: Okayama University of Science
Masaya Iizuka: Okayama University

Computational Statistics, 2023, vol. 38, issue 1, No 12, 243-262

Abstract: Abstract Principal component analysis (PCA) is a widely used descriptive multivariate technique in the analysis of quantitative data. When applying PCA to mixed quantitative and qualitative data, we utilize an optimal scaling technique for quantifying qualitative data. PCA with optimal scaling is called nonlinear PCA. The alternating least squares (ALS) algorithm is used for computing nonlinear PCA. The ALS algorithm is stable in convergence and simple in implementation; however, the algorithm tends to converge slowly for large data matrices owing to its linear convergence. Then the v $$\varepsilon $$ ε -ALS algorithm, which incorporates the vector $$\varepsilon $$ ε accelerator into the ALS algorithm, is used to accelerate the convergence of the ALS algorithm for nonlinear PCA. In this paper, we improve the v $$\varepsilon $$ ε -ALS algorithm via a restarting procedure and further reduce its number of iterations and computation time. The restarting procedure is performed under simple restarting conditions, and it speeds up the convergence of the v $$\varepsilon $$ ε -ALS algorithm. The v $$\varepsilon $$ ε -ALS algorithm with a restarting procedure is referred to as the v $$\varepsilon $$ ε R-ALS algorithm. Numerical experiments examine the performance of the v $$\varepsilon $$ ε R-ALS algorithm by comparing its number of iterations and computation time with those of the ALS and v $$\varepsilon $$ ε -ALS algorithms.

Keywords: Nonlinear principal component analysis; Alternating least squares algorithm; Acceleration of convergence; Vector $$\varepsilon $$ ε algorithm; Restarting procedure (search for similar items in EconPapers)
Date: 2023
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s00180-022-01225-4 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:compst:v:38:y:2023:i:1:d:10.1007_s00180-022-01225-4

Ordering information: This journal article can be ordered from
http://www.springer.com/statistics/journal/180/PS2

DOI: 10.1007/s00180-022-01225-4

Access Statistics for this article

Computational Statistics is currently edited by Wataru Sakamoto, Ricardo Cao and Jürgen Symanzik

More articles in Computational Statistics from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().