On some limitations of probabilistic models for dimension‐reduction: Illustration in the case of probabilistic formulations of partial least squares

Lola Etiévant and Vivian Viallon

Statistica Neerlandica, 2022, vol. 76, issue 3, 331-346

Abstract: Partial least squares (PLS) refer to a class of dimension‐reduction techniques aiming at the identification of two sets of components with maximal covariance, to model the relationship between two sets of observed variables x∈ℝp and y∈ℝq, with p≥1,q≥1. Probabilistic formulations have recently been proposed for several versions of the PLS. Focusing first on the probabilistic formulation of the PLS‐SVD proposed by el Bouhaddani et al., we establish that the constraints on their model parameters are too restrictive and define particular distributions for (x,y), under which components with maximal covariance (solutions of PLS‐SVD) are also necessarily of respective maximal variances (solutions of principal components analyses of x and y, respectively). We propose an alternative probabilistic formulation of PLS‐SVD, no longer restricted to these particular distributions. We then present numerical illustrations of the limitation of the original model of el Bouhaddani et al. We also briefly discuss similar limitations in another latent variable model for dimension‐reduction.

Date: 2022
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://doi.org/10.1111/stan.12262

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:bla:stanee:v:76:y:2022:i:3:p:331-346

Ordering information: This journal article can be ordered from
http://www.blackwell ... bs.asp?ref=0039-0402

Access Statistics for this article

Statistica Neerlandica is currently edited by Miroslav Ristic, Marijtje van Duijn and Nan van Geloven

More articles in Statistica Neerlandica from Netherlands Society for Statistics and Operations Research
Bibliographic data for series maintained by Wiley Content Delivery ().