Title :
Robust learning of neural networks ensemble for modeling
Author :
Juanyin, Qin ; Wei, Wei ; Pan, Wang
Author_Institution :
Dept. of Autom., Wuhan Univ. of Technol., China
Abstract :
Neural networks ensemble (NNE) has recently attracted great interests because of their advantages over single neural networks (SNN) as the ability of universal approximate and generalization. However, the performance of NNE trained by least squares methods deteriorates when lots of outliers emerge in I/O data. In this paper, a robust learning algorithm of NNE is applied based on the theory of robust regression that may deal well with the problems of outliers. Initial empirical study demonstrates that the robust learning algorithm of NNE has better precision and generalization than both neural networks ensemble with least square function and single neural network with the same robust algorithm do, when trained under the data with outliers.
Keywords :
generalisation (artificial intelligence); learning (artificial intelligence); least mean squares methods; modelling; neural nets; regression analysis; generalization; input-output data; least square function; least squares methods; modeling; neural network ensemble; robust learning algorithm; robust regression; single neural networks; Artificial neural networks; Cost function; Least squares approximation; Least squares methods; Network synthesis; Neural networks; Noise robustness; Statistics; System identification; Tin;
Conference_Titel :
Intelligent Control and Automation, 2004. WCICA 2004. Fifth World Congress on
Print_ISBN :
0-7803-8273-0
DOI :
10.1109/WCICA.2004.1341915