Title :
Minimizing Fisher information of the error in supervised adaptive filter training
Author :
Xu, Jian-Wu ; Erdogmus, Deniz ; Principe, Jose C.
Author_Institution :
Dept. of Electr. & Comput. Eng., Florida Univ., Gainesville, FL, USA
Abstract :
In this paper, we propose minimizing the Fisher information of the error in supervised training of linear and nonlinear adaptive filters. Fisher information considers the local structure of the error probability distribution and therefore it is a criterion that deserves to be investigated as an alternative to more common statistics such as minimum mean-square-error or minimum-error-entropy. A gradient-based training algorithm, based on a nonparametric estimator of Fisher information is presented and the performances of the three mentioned optimization criteria are compared using Monte Carlo simulations.
Keywords :
Monte Carlo methods; adaptive filters; error statistics; gradient methods; higher order statistics; nonparametric statistics; optimisation; time series; Fisher error information minimization; Fisher information nonparametric estimator; Monte Carlo simulations; chaotic time-series prediction; error probability distribution; gradient-based training algorithm; higher-order statistics; information theoretic framework; linear adaptive filters; nonGaussian data; nonlinear adaptive filters; optimality criteria; supervised adaptive filter training; Adaptive filters; Computer errors; Entropy; Error analysis; Error probability; Higher order statistics; Kernel; Linear systems; Smoothing methods; Statistical distributions;
Conference_Titel :
Acoustics, Speech, and Signal Processing, 2004. Proceedings. (ICASSP '04). IEEE International Conference on
Print_ISBN :
0-7803-8484-9
DOI :
10.1109/ICASSP.2004.1327160