DocumentCode :
1205643
Title :
Nondirect convergence radius and number of iterations of the Hopfield associative memory
Author :
Burshtein, David
Author_Institution :
Dept. of Electr. Eng., Tel Aviv Univ., Israel
Volume :
40
Issue :
3
fYear :
1994
fDate :
5/1/1994 12:00:00 AM
Firstpage :
838
Lastpage :
847
Abstract :
Considers a Hopfield associative memory consisting of n neurons, designed to store an m-set of n-dimensional ±1 statistically independent uniformly distributed random vectors (fundamental memories), using a connection matrix, constructed by the usual Hebbian rule. Previous results have indicated that the maximal value of m, such that almost all m vectors are stable points of the memory, in probability (i.e., with probability approaching one as n approaches infinity), is n/(2 log n)(n/(4 log n) if all m vectors must be stable simultaneously, in probability). Previous work further analyzed the direct convergence (i.e., convergence in one iteration) error-correcting power of the Hopfield memory. The present authors rigorously analyze the general case of nondirect convergence, and prove that in the m=n/(2 log n) case, independently of the operation mode used (synchronous or asynchronous), almost all memories have an attraction radius of size n/2 around them (in the n/(4 log n) case, all memories have such an attraction radius, in probability). This result, which was conjectured in the past but was never proved rigorously, combined with an old converse result that the network cannot store more than n/(2 log n)(n/(4 log n)) fundamental memories, gives a full picture of the error-correcting power of the Hebbian Hopfield network. The authors also upper bound the number of iterations required to achieve convergence
Keywords :
Hebbian learning; Hopfield neural nets; content-addressable storage; convergence; iterative methods; probability; Hebbian rule; Hopfield associative memory; asynchronous mode; attraction radius; connection matrix; fundamental memories; n-dimensional uniformly distributed random vectors; nondirect convergence radius; number of iterations; operation mode; probability; synchronous mode; Associative memory; Biological system modeling; Convergence; H infinity control; Helium; Hopfield neural networks; Neural networks; Neurons; Probability; Upper bound;
fLanguage :
English
Journal_Title :
Information Theory, IEEE Transactions on
Publisher :
ieee
ISSN :
0018-9448
Type :
jour
DOI :
10.1109/18.335894
Filename :
335894
Link To Document :
بازگشت