Theoretical and practical considerations on the convergence properties of the Fisher-EM algorithm

Charles Bouveyron and Camille Brunet

Journal of Multivariate Analysis, 2012, vol. 109, issue C, 29-41

Abstract: The Fisher-EM algorithm has been recently proposed in Bouveyron and Brunet (2012) [5] for the simultaneous visualization and clustering of high-dimensional data. It is based on a latent mixture model which fits the data into a latent discriminative subspace with a low intrinsic dimension. Although the Fisher-EM algorithm is based on the EM algorithm, it does not respect at a first glance all conditions of the EM convergence theory. Its convergence toward a maximum of the likelihood is therefore questionable. The aim of this work is twofold. First, the convergence of the Fisher-EM algorithm is studied from the theoretical point of view. In particular, it is proved that the algorithm converges under weak conditions in the general case. Second, the convergence of the Fisher-EM algorithm is considered from the practical point of view. It is shown that the Fisher criterion can be used as a stopping criterion for the algorithm to improve the clustering accuracy. It is also shown that the Fisher-EM algorithm converges faster than both the EM and CEM algorithm.

Keywords: High-dimensional data; Model-based clustering; Discriminative subspace; Fisher-EM algorithm; Convergence properties (search for similar items in EconPapers)
Date: 2012
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0047259X1200053X
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:jmvana:v:109:y:2012:i:c:p:29-41

Ordering information: This journal article can be ordered from
http://www.elsevier.com/wps/find/supportfaq.cws_home/regional
https://shop.elsevie ... _01_ooc_1&version=01

DOI: 10.1016/j.jmva.2012.02.012

Access Statistics for this article

Journal of Multivariate Analysis is currently edited by de Leeuw, J.

More articles in Journal of Multivariate Analysis from Elsevier
Bibliographic data for series maintained by Catherine Liu ().