• DocumentCode
    2491765
  • Title

    Research on the methods of improving the training speed of LMBP algorithm

  • Author

    Xu, Wenshang ; Yu, Zhenbo ; Yu, Qingming ; Sun, Yanliang ; Dong, Tianwen

  • Author_Institution
    Control Eng. Lab., Shandong Univ. of Sci. & Technol., Qingdao
  • fYear
    2008
  • fDate
    25-27 June 2008
  • Firstpage
    5281
  • Lastpage
    5286
  • Abstract
    The paper talks about several numerical methods of improving the training speed of LMBP algorithm and the corresponding amount of computation in LMBP algorithms. According to the characteristic of formula LMBP algorithm, we propose a suitable method to reduce the calculation quantity and improve the training speed of LMBP algorithm and apply it into the basic LMBP algorithm. This method has less computation compared to several other numerical methods and improves network training speed greatly when calculating the increments of weights and biases. Finally we do several training simulations with several typical network training swatches. The simulation results indicate that total training speed of single hidden layer BP neural network based on improved LMBP algorithm converges very rapidly and has good precision compared with the basic LMBP algorithm.
  • Keywords
    backpropagation; neural nets; LMBP algorithm; network training; single hidden layer BP neural network; training speed; Artificial neural networks; Computational modeling; Convergence of numerical methods; Equations; Gaussian processes; Intelligent control; Matrix decomposition; Neural networks; Newton method; Symmetric matrices; Gauss-Jordan elimination; LMBP algorithm; square root method; symmetrical and positive definite;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Intelligent Control and Automation, 2008. WCICA 2008. 7th World Congress on
  • Conference_Location
    Chongqing
  • Print_ISBN
    978-1-4244-2113-8
  • Electronic_ISBN
    978-1-4244-2114-5
  • Type

    conf

  • DOI
    10.1109/WCICA.2008.4593789
  • Filename
    4593789