Title :
The backpropagation unfold recurrent rule
Author :
Chan, Lai-Wan ; Chiu, Phyllis T T ; Chow, Janet Y W
Author_Institution :
Dept. of Comput. Sci., Chinese Univ. of Hong Kong, Shatin, Hong Kong
Abstract :
A novel learning algorithm for recurrent backpropagation (BP) networks is introduced. Existing learning algorithms of the recurrent models are mostly based on the static generalized delta-rule of the BP algorithm which does not give satisfactory results for a recurrent network. The authors derived the BP unfold recurrent rule (BURR) by unfolding the structure of the recurrent network. Using this learning rule, the connecting weights are updated by accumulating the effects of the weight change in each time interval. Experimental results are presented to demonstrate the memorizing ability of a recurrent network using this learning algorithm. Sequences of input characters were successfully recognized
Keywords :
character recognition; learning systems; neural nets; BP unfold recurrent rule; BURR; backpropagation unfold recurrent rule; connecting weights; input characters; learning algorithm; memorizing ability; time interval; Backpropagation algorithms; Character recognition; Computer science; Feedback loop; Joining processes; Neural networks; Neurofeedback; Output feedback; Recurrent neural networks; Signal processing;
Conference_Titel :
Neural Networks, 1991. 1991 IEEE International Joint Conference on
Print_ISBN :
0-7803-0227-3
DOI :
10.1109/IJCNN.1991.170487