Title :
The EM algorithm in independent component analysis
Author :
Petersen, Kaare Brandt ; Winther, Ole
Author_Institution :
IMM, Tech. Univ. Denmark, Lyngby, Denmark
Abstract :
We investigate two techniques for independent component analysis which use the expectation-maximization algorithm. Analysis and simulations show that convergence becomes extraordinarily slow for almost all cases, compared to other optimization techniques. The two alternatives considered are "adaptive overrelaxed EM" and Ucminf (a BFGS with soft line search), which both improves the convergence dramatically with little or no extra analytical work. We discuss the generality and perspectives of the findings.
Keywords :
convergence of numerical methods; independent component analysis; optimisation; random noise; signal processing; adaptive overrelaxed EM; expectation-maximization algorithm; independent component analysis; optimization; signal processing; soft line search; Acceleration; Algorithm design and analysis; Analytical models; Convergence; Cost function; Covariance matrix; Expectation-maximization algorithms; Independent component analysis; Maximum likelihood estimation; Proposals;
Conference_Titel :
Acoustics, Speech, and Signal Processing, 2005. Proceedings. (ICASSP '05). IEEE International Conference on
Print_ISBN :
0-7803-8874-7
DOI :
10.1109/ICASSP.2005.1416267