Title :
Pilot Study on the Localized Generalization Error Model for Single Layer Perceptron Neural Network
Author :
Ng, Wing W Y ; Yeung, Daniel S. ; Tsang, Eric C C
Author_Institution :
Media & Life Sci. Comput. Lab., Harbin Inst. of Technol., Shenzhen
Abstract :
We had developed the localized generalization error model for supervised learning with minimization of mean square error. In this work, we extend the error model to single layer perceptron neural network (SLPNN). For a trained SLPNN and a given training dataset, the proposed error model bounds above the error for unseen samples which are similar to the training samples. This pilot study is the important first step of investigating localized generalization error models for multilayer perceptron neural networks and support vector machines with sigmoid kernel functions. The characteristics of the error model for SLPNN and how to compare SLPNNs´ generalization capabilities using the error model are also discussed in this paper
Keywords :
generalisation (artificial intelligence); learning (artificial intelligence); mean square error methods; multilayer perceptrons; support vector machines; Sigmoid kernel function; localized generalization error model; mean square error minimization; multilayer perceptron neural network; single layer perceptron neural network; supervised learning; support vector machine; Analytical models; Computer networks; Cybernetics; Electronic mail; Industrial training; Laboratories; Machine learning; Multilayer perceptrons; Neural networks; Neurons; Pattern classification; Supervised learning; Support vector machine classification; Support vector machines; Localized Generalization Error Bound; Single Layer Perceptron Neural Network;
Conference_Titel :
Machine Learning and Cybernetics, 2006 International Conference on
Conference_Location :
Dalian, China
Print_ISBN :
1-4244-0061-9
DOI :
10.1109/ICMLC.2006.258370