DocumentCode :
1842965
Title :
The impact of the error function selection in neural network-based classifiers
Author :
Falas, Tasos ; Stafylopatis, A.-G.
Author_Institution :
Dept. of Electr. & Comput. Eng., Nat. Tech. Univ. of Athens, Greece
Volume :
3
fYear :
1999
fDate :
1999
Firstpage :
1799
Abstract :
This paper presents the results of a comparative study on the impact of various error functions in multilayer feedforward neural networks used for classification problems. The objective is the comparison of the properties of the error functions, both in terms of the training speed and the generalization ability. In an effort to avoid complexities introduced by more advanced learning algorithms, the simple backpropagation with momentum algorithm has been employed. A member of classification problems were solved with neural networks that have been trained with the usual mean square error function, the mean absolute error function, the cross-entropy or maximum likelihood function, the Kalman-Kwasny error function (1991), as well as a novel error function designed by the authors. The results indicate that, in most problems examined, an error function other than the usual mean square gives a better performance, both in terms of the number of epochs needed for training, as well as the obtained generalization ability of the trained network
Keywords :
backpropagation; feedforward neural nets; generalisation (artificial intelligence); multilayer perceptrons; pattern classification; Kalman-Kwasny error function; backpropagation; cross-entropy function; error function selection; generalization ability; maximum likelihood function; mean absolute error function; mean square error function; multilayer feedforward neural networks; neural network-based classifiers; training speed; Algorithm design and analysis; Computer errors; Computer science; Equations; Error correction; Feedforward neural networks; Intelligent networks; Iterative algorithms; Mean square error methods; Neural networks;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Neural Networks, 1999. IJCNN '99. International Joint Conference on
Conference_Location :
Washington, DC
ISSN :
1098-7576
Print_ISBN :
0-7803-5529-6
Type :
conf
DOI :
10.1109/IJCNN.1999.832651
Filename :
832651
Link To Document :
بازگشت