Title :
Neural training of complex sequential associations using recurrent continuous backpropagation
Author :
Chen, Li H. ; Tan, Poy B. ; Wei, Mike K. ; Foo, Shou K.
Author_Institution :
Sch. of Electr. & Electron. Eng., Nanyang Technol. Inst., Singapore
Abstract :
Proposes a path-based neural network algorithm called recurrent continuous backpropagation two (RCBP-2) for complex sequential processing using a gradient descent method. Under the path-based approach, the goal weights are a collection of weight states. Coupled with the underlying continuity of training exemplars and sequential nature of the system attributes, RCBP-2 can achieve arbitrarily close approximations of complex trajectories within a fixed and relatively small network topology. The performance of RCBP-2 is also monitored by training and subsequently testing on a 4-orbits problem. The results show that RCBP-2 results in a fast and efficient algorithm for complex sequential processing
Keywords :
backpropagation; recurrent neural nets; 4-orbits problem; RCBP-2; complex sequential associations; gradient descent method; neural training; path-based approach; path-based neural network algorithm; recurrent continuous backpropagation; training exemplars; Algorithm design and analysis; Backpropagation algorithms; Cost function; Monitoring; Network topology; Neural networks; Recurrent neural networks; Testing; Training data;
Conference_Titel :
Neural Networks, 1995. Proceedings., IEEE International Conference on
Conference_Location :
Perth, WA
Print_ISBN :
0-7803-2768-3
DOI :
10.1109/ICNN.1995.488103