Title :
A New Independent Component Analysis Algorithm Based on Extended-Natural Gradient
Author :
Li, Lei ; Yan, Fei ; Zha, Fu-Zheng ; Nie, Ling-ye
Author_Institution :
Nanjing Univ. of Posts & Telecommun., Nanjing
Abstract :
In this paper, a new extended concept of directional derivative named extend-directional derivative, which is a reasonable extension of the conventional derivative, is induced based on the old counterpart. Meanwhile, with this similar method, using this extension in BSS problems and ICA based algorithms, a new concept named extended-natural gradient, whose specific form depends on a translation function on the independent variable matrix, is brought forward to solve the puzzle we have been facing. With the assist of ICALAB software package, we conduct these new algorithms, observe the actual separation effect and analyze the performance and convergence rate of them, all of which are tested in MATLAB simulation environment. The results show that, with proper translation function chosen, extended algorithm converges much faster than conventional natural gradient algorithm. No doubt this is a great improvement from the view of accelerate the execution of natural gradient algorithm, as well as in deeply research in the natural gradient algorithm itself and delivering new algorithms to solve the blind separation problems.
Keywords :
gradient methods; independent component analysis; mathematics computing; matrix algebra; software packages; MATLAB simulation environment; blind separation problem; extended-natural gradient algorithm; independent component analysis algorithm; independent variable matrix; software package; Acceleration; Algorithm design and analysis; Analytical models; Convergence; Independent component analysis; MATLAB; Performance analysis; Software algorithms; Software packages; Software testing; BSS; Extended-directional derivative; Extended-natural gradient; ICA; Matrix translation function;
Conference_Titel :
Machine Learning and Cybernetics, 2007 International Conference on
Conference_Location :
Hong Kong
Print_ISBN :
978-1-4244-0973-0
Electronic_ISBN :
978-1-4244-0973-0
DOI :
10.1109/ICMLC.2007.4370550