Title :
Variable-step BP training algorithm with an adaptive momentum term
Author :
Huizhong, Yang ; Danjing, Li ; Zhenlin, Tao ; Suzhen, Zhang
Author_Institution :
Res. Inst. of Autom., East China Univ., Shanghai, China
Abstract :
This paper proposes a new variable-step BP training algorithm which can overcome some disadvantages of the traditional BP training algorithm such as slow convergent speed and tendency of getting the local minima. In the new method, a nonlinear property term is introduced and its intensity coefficient is constructed as an adaptive nonlinear function, which processes the temperature ascending and temperature descending strategy. The simulation results show the efficiency of the new method.
Keywords :
backpropagation; neural nets; adaptive momentum term; adaptive nonlinear function; backpropagation; intensity coefficient; local minima; neural network; nonlinear property term; simulation; slow convergent speed; temperature ascending strategy; temperature descending strategy; variable-step BP training algorithm; Adaptive control; Automation; Convergence; Gradient methods; Joining processes; Neural networks; Neurons; Optimization methods; Programmable control; Temperature control;
Conference_Titel :
Intelligent Control and Automation, 2002. Proceedings of the 4th World Congress on
Print_ISBN :
0-7803-7268-9
DOI :
10.1109/WCICA.2002.1021427