Acceleration of the EM algorithm: P-EM versus epsilon algorithm

A.F. Berlinet and Ch. Roland

Computational Statistics & Data Analysis, 2012, vol. 56, issue 12, 4122-4137

Abstract: Among recent methods designed for accelerating the EM algorithm without any modification in the structure of EM or in the statistical model, the parabolic acceleration (P-EM) has proved its efficiency. It does not involve any computation of gradient or hessian matrix and can be used as an additional software component of any fixed point algorithm maximizing some objective function. The vector epsilon algorithm was introduced to reach the same goals. Through geometric considerations, the relationships between the outputs of an improved version of P-EM and those of the vector epsilon algorithm are established. This sheds some light on their different behaviours and explains why the parabolic acceleration of EM outperforms its competitor in most numerical experiments. A detailed analysis of its trajectories in a variety of real or simulated data shows the ability of P-EM to choose the most efficient paths to the global maximum of the likelihood.

Keywords: EM algorithm; Fixed point iteration; Acceleration; Convergence; Epsilon algorithm (search for similar items in EconPapers)
Date: 2012
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (4)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0167947312001314
Full text for ScienceDirect subscribers only.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:csdana:v:56:y:2012:i:12:p:4122-4137

DOI: 10.1016/j.csda.2012.03.005

Access Statistics for this article

Computational Statistics & Data Analysis is currently edited by S.P. Azen

More articles in Computational Statistics & Data Analysis from Elsevier
Bibliographic data for series maintained by Catherine Liu ().