DocumentCode
1728466
Title
Nearly-optimal associative memories based on distributed constant weight codes
Author
Gripon, Vincent ; Berrou, Claude
Author_Institution
Electron. & Comput. Enginering, McGill Univ., Montreal, QC, Canada
fYear
2012
Firstpage
269
Lastpage
273
Abstract
A new family of sparse neural networks achieving nearly optimal performance has been recently introduced. In these networks, messages are stored as cliques in clustered graphs. In this paper, we interpret these networks using the formalism of error correcting codes. To achieve this, we introduce two original codes, the thrifty code and the clique code, that are both sub-families of binary constant weight codes. We also provide the networks with an enhanced retrieving rule that enables a property of answer correctness and that improves performance.
Keywords
binary codes; content-addressable storage; error correction codes; graphs; neural nets; binary constant weight codes; clique code; clustered graphs; distributed constant weight codes; error correcting codes; nearly-optimal associative memories; sparse neural networks; thrifty code; Associative memory; Computer architecture; Decoding; Error correction codes; Hamming distance; Neural networks; Neurons; associative memory; classification; clique code; constant weight codes; sparse neural networks; thrifty code; winner-take-all;
fLanguage
English
Publisher
ieee
Conference_Titel
Information Theory and Applications Workshop (ITA), 2012
Conference_Location
San Diego, CA
Print_ISBN
978-1-4673-1473-2
Type
conf
DOI
10.1109/ITA.2012.6181790
Filename
6181790
Link To Document