Title :
A CramÉr-Rao Bound Characterization of the EM-Algorithm Mean Speed of Convergence
Author :
Herzet, Cédric ; Ramon, Valéry ; Renaux, Alexandre ; Vandendorpe, Luc
Author_Institution :
INRIA/IRISA, Univ. de Beaulieu, Rennes
fDate :
6/1/2008 12:00:00 AM
Abstract :
This paper deals with the mean speed of convergence of the expectation-maximization (EM) algorithm. We show that the asymptotic behavior (in terms of the number of observations) of the EM algorithm can be characterized as a function of the Cramer-Rao bounds (CRBs) associated to the so-called incomplete and complete data sets defined within the EM-algorithm framework. We particularize our result to the case of a complete data set defined as the concatenation of the observation vector and a vector of nuisance parameters, independent of the parameter of interest. In this particular case, we show that the CRB associated to the complete data set is nothing but the well-known modified CRB. Finally, we show by simulation that the proposed expression enables to properly characterize the EM-algorithm mean speed of convergence from the CRB behavior when the size of the observation set is large enough.
Keywords :
convergence of numerical methods; expectation-maximisation algorithm; iterative methods; Cramer-Rao bound characterization; convergence of numerical methods; expectation-maximization algorithm; iterative methods; Convergence; Genetic expression; Iterative algorithms; Iterative methods; Laboratories; Maximum likelihood estimation; Phase estimation; Remote sensing; Robustness; State estimation; Convergence of numerical methods; iterative methods; maximum-likelihood estimation;
Journal_Title :
Signal Processing, IEEE Transactions on
DOI :
10.1109/TSP.2008.917024