Title :
Noise robustness enhancement using fourth-order cumulants cost function
Author :
Leung, C.T. ; Chow, T.W.S.
Author_Institution :
Dept. of Electron. Eng., City Univ. of Hong Kong, Kowloon, Hong Kong
Abstract :
A novel robust fourth-order cumulants cost function is introduced to enhance the fitting to underlying function in small data sets with high noise level of Gaussian noise. The neural network learns based on the gradient descent optimization method by introducing a constraint term in the cost function. The proposed cost function was applied to benchmark sunspot series prediction and nonlinear system identification. Excellent results are obtained. The neural network can provide lower training error and excellent generalization property. Our proposed cost function enables the network to provide, at most, 73% reduction of normalized test error in the benchmark test
Keywords :
Gaussian noise; feedforward neural nets; higher order statistics; identification; nonlinear systems; optimisation; prediction theory; Gaussian noise; constraint term; fourth-order cumulants cost function; function fitting; generalization; gradient descent optimization method; noise robustness enhancement; nonlinear system identification; sunspot series prediction; Backpropagation algorithms; Benchmark testing; Cost function; Data engineering; Function approximation; Gaussian noise; Least squares methods; Neural networks; Noise level; Noise robustness;
Conference_Titel :
Neural Networks, 1996., IEEE International Conference on
Conference_Location :
Washington, DC
Print_ISBN :
0-7803-3210-5
DOI :
10.1109/ICNN.1996.549194