Title :
Time sequential pattern transformation and attractors of recurrent neural networks
Author :
Takase, Haruhiko ; Gouhara, Kazutoshi ; Uchikawa, Yoshiki
Author_Institution :
Dept. of Electron. Mech. Eng., Nagoya Univ., Japan
Abstract :
For better understanding the function of recurrent neural networks (RNN), we propose that an external input is considered as one period of an oscillatory input. It follows from this that an external time sequential input corresponds to an attractor in a vector field. We show experimentally that RNN can learn: (1) input-output time sequential patterns as trajectories of attractors, and (2) transition between attractors.
Keywords :
learning (artificial intelligence); recurrent neural nets; vectors; attractor learning; backpropagation through time; input-output time sequence; learning pattern; oscillatory input; recurrent neural networks; time sequential pattern transformation; vector field; Cost function; Differential equations; Feedback loop; Hopfield neural networks; Multi-layer neural network; Multidimensional systems; Network topology; Neural networks; Neurons; Recurrent neural networks;
Conference_Titel :
Neural Networks, 1993. IJCNN '93-Nagoya. Proceedings of 1993 International Joint Conference on
Print_ISBN :
0-7803-1421-2
DOI :
10.1109/IJCNN.1993.714189