Title :
A hybrid algorithm of weight evolution and generalized back-propagation for finding global minimum
Author :
Ng, Sin-Chun ; Hung, Shu-Hung ; Luk, Andrew
Author_Institution :
Dept. of Comput. & Math., Hong Kong Inst. of Vocational Educ., Hong Kong
Abstract :
Concerns feedforward neural net training. The conventional backpropagation algorithm will always get stuck into local minima and converge very slowly. Other fast algorithms can increase the convergence speed however they still converge to local minima. We introduce a new hybrid algorithm with the use of weight evolution into the generalized back-propagation method. The hybrid algorithm further improve the convergence rate and the global convergence capability, it ensures the convergence to a global minimum in a compact region of a weight vector space
Keywords :
backpropagation; convergence; feedforward neural nets; minimisation; convergence; feedforward neural net training; generalized back-propagation; generalized backpropagation; global minimum; hybrid algorithm; weight evolution; Australia; Convergence; Evolutionary computation; Feedforward neural networks; Feedforward systems; Investments; Mathematics; Neural networks; Neurons; Optimization methods;
Conference_Titel :
Neural Networks, 1999. IJCNN '99. International Joint Conference on
Conference_Location :
Washington, DC
Print_ISBN :
0-7803-5529-6
DOI :
10.1109/IJCNN.1999.830806