Title :
A fast learning algorithm of neural networks by changing error functions
Author :
Jiang, Minghu ; Deng, Beixing ; Wang, Bin ; Bo Zhang
Author_Institution :
Dept. of Chinese Language, Tsinghua Univ., Beijing, China
Abstract :
In order to improve the training speed of multilayer feedforward neural networks, we propose and explore a new fast backpropagation (BP) algorithms obtained by changing the error functions, in case using the Fourier kernel function as alternative functions; to overcome the conventional BP learning problems of getting stuck into local minima or slow convergence. Our experimental results demonstrate the effectiveness of the modified error functions since the training speed is faster than that of existing fast methods.
Keywords :
Fourier analysis; backpropagation; convergence; feedforward neural nets; optimisation; Fourier kernel function; backpropagation algorithms; convergence rate; error functions; fast learning algorithm; multilayer feedforward neural networks; parameter optimization; Algorithm design and analysis; Backpropagation algorithms; Computational linguistics; Computer errors; Computer science; Convergence; Kernel; Multi-layer neural network; Natural languages; Neural networks;
Conference_Titel :
Neural Networks and Signal Processing, 2003. Proceedings of the 2003 International Conference on
Conference_Location :
Nanjing
Print_ISBN :
0-7803-7702-8
DOI :
10.1109/ICNNSP.2003.1279258