Title :
Error whitening criterion for linear filter estimation
Author :
Rao, Yadunandana N. ; Erdogmus, Deniz ; Principe, Jose C.
Author_Institution :
Dept. of Electr. & Comput. Eng., Florida Univ., Gainesville, FL, USA
Abstract :
Mean square error (MSE) has been the most widely used tool to solve the linear filter estimation or system identification problem. However, MSE gives biased results when the input signals are noisy. This paper presents a novel error whitening criterion (EWC) to tackle the problem of linear system identification in the presence of additive white disturbances. We would motivate the theory behind the new criterion and derive an online stochastic gradient algorithm based on EWC. Convergence proof of the stochastic gradient algorithm is derived making mild assumptions. Simulation results show the effectiveness of this criterion. We compare its performance with MSE as well as the powerful total least squares method.
Keywords :
adaptive filters; error analysis; filtering theory; mean square error methods; additive white disturbances; error whitening criterion; linear filter estimation; mean square error; online stochastic gradient algorithm; system identification problem; total least squares method; Adaptive filters; Additive noise; Additive white noise; Autocorrelation; Computer errors; Laboratories; Neural engineering; Nonlinear filters; Stochastic processes; Wiener filter;
Conference_Titel :
Neural Networks, 2003. Proceedings of the International Joint Conference on
Print_ISBN :
0-7803-7898-9
DOI :
10.1109/IJCNN.2003.1223909