DocumentCode
1256674
Title
On the capacity of ternary Hebbian networks
Author
Baram, Yoram
Author_Institution
Dept. of Comput. Sci., Technion-Israel Inst. of Technol., Haifa, Israel
Volume
37
Issue
3
fYear
1991
fDate
5/1/1991 12:00:00 AM
Firstpage
528
Lastpage
534
Abstract
Networks of ternary neurons storing random vectors over the set (-1,0,1) by the so-called Hebbian rule are considered. It is shown that the maximal number of stored patterns that are equilibrium states of the network with probability tending to one as N tends to infinity is at least on the order of N2-1/ alpha /K, where N is the number of neurons, K is the number of nonzero elements in a pattern. and t= alpha K, 1/2< alpha <1, is the threshold in the neuron function. While. for small K, this bound is similar to that obtained for fully connected binary networks, the number of interneural connections required in the ternary case is considerably smaller. Similar bounds, incorporating error probabilities, are shown to guarantee, in the same probabilistic sense, the correction of errors in the nonzero elements and in the location of these elements.
Keywords
content-addressable storage; error correction; neural nets; Hebbian networks; associative memory capacity; capacity; equilibrium states; error correction; error probabilities; interneural connections; maximal number of stored patterns; nonzero elements; random vectors; ternary neurons; Associative memory; Error correction; Error probability; H infinity control; Hopfield neural networks; Neural networks; Neurons; Pattern analysis; Sampling methods; Upper bound;
fLanguage
English
Journal_Title
Information Theory, IEEE Transactions on
Publisher
ieee
ISSN
0018-9448
Type
jour
DOI
10.1109/18.79908
Filename
79908
Link To Document