Title :
Optimization of a network with Gaussian kernel functions based on the estimation of error confidence intervals
Author :
Kil, Rhee Man ; Koo, Imhoi
Author_Institution :
Div. of Appl. Math., Korea Adv. Inst. of Sci. & Technol., Taejon, South Korea
Abstract :
Presents a method of regression based on a network with Gaussian kernel functions (GKFs) which is trained from a set of training samples for function approximation. For the regression of a network with GKFs, the error confidence interval defined by the absolute value of difference between the general and empirical risks, instead of using the validation set, is derived in the sense of probably approximately correct (PAC) learning. However, the coefficients in this theoretical bound is too overestimated and dependent upon the given samples and network models. In this sense, the estimation model of error confidence interval is suggested and the coefficients of the suggested model are estimated for the given samples and network models. The estimated error confidence intervals are then used to check the training of network model in the sense of minimizing the general error. To show the effectiveness of our approach, the error confidence intervals for the prediction of Mackey-Glass time series are estimated and compared with the experimental results
Keywords :
estimation theory; function approximation; generalisation (artificial intelligence); learning (artificial intelligence); neural nets; radial basis function networks; time series; Gaussian kernel functions; Mackey-Glass time series; PAC learning; error confidence intervals; function approximation; network model; probably approximately correct learning; regression method; Electronic mail; Estimation error; Function approximation; Kernel; Mathematics; Monitoring; Recruitment; Shape; Upper bound; Vectors;
Conference_Titel :
Neural Networks, 2001. Proceedings. IJCNN '01. International Joint Conference on
Conference_Location :
Washington, DC
Print_ISBN :
0-7803-7044-9
DOI :
10.1109/IJCNN.2001.938428