Title :
Cramer-Rao lower bound for linear independent component analysis
Author :
Z. Koldovsky;P. Tichavsky;E. Oja
Author_Institution :
Inst. of Inf. Theor. & Autom., Prague, Czech Republic
fDate :
6/27/1905 12:00:00 AM
Abstract :
This paper derives a closed-form expression for the Cramer-Rao bound (CRB) on estimating the source signals in the linear independent component analysis problem, assuming that all independent components have finite variance. It is also shown that the fixed-point algorithm known as FastICA can approach the CRB (the estimate can be nearly efficient) in two situations: (1) when the distribution of the sources is not too much different from Gaussian, for the symmetric version of the algorithm using any of the custom nonlinear functions (pow3, tanh, gauss); (2) when the distribution of the sources is very different from Gaussian (e.g. has long tails) and the nonlinear function in the algorithm equals the score function of each independent component.
Keywords :
"Independent component analysis","Source separation","Jacobian matrices","Information theory","Automation","Nuclear and plasma sciences","Neural networks","Closed-form solution","Gaussian distribution","Probability distribution"
Conference_Titel :
Acoustics, Speech, and Signal Processing, 2005. Proceedings. (ICASSP ´05). IEEE International Conference on
Print_ISBN :
0-7803-8874-7
DOI :
10.1109/ICASSP.2005.1415776