DocumentCode
2709226
Title
Dynamic associative memory, based on open recurrent neural network
Author
Reznik, Alexander M. ; Dziuba, Dmitry A.
Author_Institution
Inst. of Math. Machines & Syst. Problems, NAS of Ukraine, Ukraine
fYear
2009
fDate
14-19 June 2009
Firstpage
2657
Lastpage
2663
Abstract
Mathematical model of open dynamic recurrent neural network, that hasn´t hidden neurons, is described. Such network has dynamic attractors, that are sequences of transitions between one attractor state to another, according to input signal sequences. Concept of ldquofreezingrdquo of such dynamics with the use of virtual static recurrent network is proposed. Solution of generalized stability equation is used for development of non-iterative method for training dynamic recurrent networks. Estimations of attraction radius and training set size are obtained. Using of the open dynamic recurrent network as dynamic associative memory is studied and possibility of control of dynamic attractors by changing level of influence of different feedback components is shown. Software model of the network was developed, and experimental study of its behavior for reproducing of sequences of distorted vectors was performed. Analogy between dynamic attractors and neural activity patterns, that support hypothesis of local neural ensembles, with structure and functions similar to dynamic recurrent networks in neocortex, is remarked.
Keywords
content-addressable storage; control engineering computing; feedback; recurrent neural nets; attraction radius; dynamic associative memory; dynamic attractors control; feedback components; generalized stability equation; neocortex; neural activity patterns; non-iterative method; open dynamic recurrent neural network; training set size; virtual static recurrent network; Associative memory; Brain modeling; Equations; Image recognition; Neural networks; Neurofeedback; Neurons; Recurrent neural networks; Software performance; Stability;
fLanguage
English
Publisher
ieee
Conference_Titel
Neural Networks, 2009. IJCNN 2009. International Joint Conference on
Conference_Location
Atlanta, GA
ISSN
1098-7576
Print_ISBN
978-1-4244-3548-7
Electronic_ISBN
1098-7576
Type
conf
DOI
10.1109/IJCNN.2009.5178767
Filename
5178767
Link To Document