Title :
Design of new kernel density estimator for entropy maximization in independent component analysis
Author :
Kim, Woong Myung ; Lee, Hyon Soo
Author_Institution :
Dept. of Comput. Eng., Kyung Hee Univ., Kyungki, South Korea
Abstract :
This paper proposes a new algorithm for estimating the score function using maximum entropy theory and kernel density estimation. The main idea is to control smoothing parameters for maximizing entropy in kernel density estimation. To generate score function, directly partial derivative equation from kernel density estimator is derived. To find suitable smoothing parameter, we adopted gradient descent method. Finally, the new kernel density estimator is experimented in blind separation and discuss on properties of the proposed learning algorithm.
Keywords :
blind source separation; gradient methods; independent component analysis; learning (artificial intelligence); maximum entropy methods; operating system kernels; blind separation; directly partial derivative equation; gradient descent method; kernel density estimation; maximum entropy theory; score function generation; smoothing parameter control; Algorithm design and analysis; Blind source separation; Design engineering; Differential equations; Entropy; Independent component analysis; Kernel; Neural networks; Nonlinear equations; Smoothing methods;
Conference_Titel :
Information, Communications and Signal Processing, 2003 and Fourth Pacific Rim Conference on Multimedia. Proceedings of the 2003 Joint Conference of the Fourth International Conference on
Print_ISBN :
0-7803-8185-8
DOI :
10.1109/ICICS.2003.1292656