Title :
Research on the methods of improving the training speed of LMBP algorithm
Author :
Xu, Wenshang ; Yu, Zhenbo ; Yu, Qingming ; Sun, Yanliang ; Dong, Tianwen
Author_Institution :
Control Eng. Lab., Shandong Univ. of Sci. & Technol., Qingdao
Abstract :
The paper talks about several numerical methods of improving the training speed of LMBP algorithm and the corresponding amount of computation in LMBP algorithms. According to the characteristic of formula LMBP algorithm, we propose a suitable method to reduce the calculation quantity and improve the training speed of LMBP algorithm and apply it into the basic LMBP algorithm. This method has less computation compared to several other numerical methods and improves network training speed greatly when calculating the increments of weights and biases. Finally we do several training simulations with several typical network training swatches. The simulation results indicate that total training speed of single hidden layer BP neural network based on improved LMBP algorithm converges very rapidly and has good precision compared with the basic LMBP algorithm.
Keywords :
backpropagation; neural nets; LMBP algorithm; network training; single hidden layer BP neural network; training speed; Artificial neural networks; Computational modeling; Convergence of numerical methods; Equations; Gaussian processes; Intelligent control; Matrix decomposition; Neural networks; Newton method; Symmetric matrices; Gauss-Jordan elimination; LMBP algorithm; square root method; symmetrical and positive definite;
Conference_Titel :
Intelligent Control and Automation, 2008. WCICA 2008. 7th World Congress on
Conference_Location :
Chongqing
Print_ISBN :
978-1-4244-2113-8
Electronic_ISBN :
978-1-4244-2114-5
DOI :
10.1109/WCICA.2008.4593789