• DocumentCode
    1256674
  • Title

    On the capacity of ternary Hebbian networks

  • Author

    Baram, Yoram

  • Author_Institution
    Dept. of Comput. Sci., Technion-Israel Inst. of Technol., Haifa, Israel
  • Volume
    37
  • Issue
    3
  • fYear
    1991
  • fDate
    5/1/1991 12:00:00 AM
  • Firstpage
    528
  • Lastpage
    534
  • Abstract
    Networks of ternary neurons storing random vectors over the set (-1,0,1) by the so-called Hebbian rule are considered. It is shown that the maximal number of stored patterns that are equilibrium states of the network with probability tending to one as N tends to infinity is at least on the order of N2-1/ alpha /K, where N is the number of neurons, K is the number of nonzero elements in a pattern. and t= alpha K, 1/2< alpha <1, is the threshold in the neuron function. While. for small K, this bound is similar to that obtained for fully connected binary networks, the number of interneural connections required in the ternary case is considerably smaller. Similar bounds, incorporating error probabilities, are shown to guarantee, in the same probabilistic sense, the correction of errors in the nonzero elements and in the location of these elements.
  • Keywords
    content-addressable storage; error correction; neural nets; Hebbian networks; associative memory capacity; capacity; equilibrium states; error correction; error probabilities; interneural connections; maximal number of stored patterns; nonzero elements; random vectors; ternary neurons; Associative memory; Error correction; Error probability; H infinity control; Hopfield neural networks; Neural networks; Neurons; Pattern analysis; Sampling methods; Upper bound;
  • fLanguage
    English
  • Journal_Title
    Information Theory, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9448
  • Type

    jour

  • DOI
    10.1109/18.79908
  • Filename
    79908