• DocumentCode
    1205643
  • Title

    Nondirect convergence radius and number of iterations of the Hopfield associative memory

  • Author

    Burshtein, David

  • Author_Institution
    Dept. of Electr. Eng., Tel Aviv Univ., Israel
  • Volume
    40
  • Issue
    3
  • fYear
    1994
  • fDate
    5/1/1994 12:00:00 AM
  • Firstpage
    838
  • Lastpage
    847
  • Abstract
    Considers a Hopfield associative memory consisting of n neurons, designed to store an m-set of n-dimensional ±1 statistically independent uniformly distributed random vectors (fundamental memories), using a connection matrix, constructed by the usual Hebbian rule. Previous results have indicated that the maximal value of m, such that almost all m vectors are stable points of the memory, in probability (i.e., with probability approaching one as n approaches infinity), is n/(2 log n)(n/(4 log n) if all m vectors must be stable simultaneously, in probability). Previous work further analyzed the direct convergence (i.e., convergence in one iteration) error-correcting power of the Hopfield memory. The present authors rigorously analyze the general case of nondirect convergence, and prove that in the m=n/(2 log n) case, independently of the operation mode used (synchronous or asynchronous), almost all memories have an attraction radius of size n/2 around them (in the n/(4 log n) case, all memories have such an attraction radius, in probability). This result, which was conjectured in the past but was never proved rigorously, combined with an old converse result that the network cannot store more than n/(2 log n)(n/(4 log n)) fundamental memories, gives a full picture of the error-correcting power of the Hebbian Hopfield network. The authors also upper bound the number of iterations required to achieve convergence
  • Keywords
    Hebbian learning; Hopfield neural nets; content-addressable storage; convergence; iterative methods; probability; Hebbian rule; Hopfield associative memory; asynchronous mode; attraction radius; connection matrix; fundamental memories; n-dimensional uniformly distributed random vectors; nondirect convergence radius; number of iterations; operation mode; probability; synchronous mode; Associative memory; Biological system modeling; Convergence; H infinity control; Helium; Hopfield neural networks; Neural networks; Neurons; Probability; Upper bound;
  • fLanguage
    English
  • Journal_Title
    Information Theory, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9448
  • Type

    jour

  • DOI
    10.1109/18.335894
  • Filename
    335894