Title :
Nearly-optimal associative memories based on distributed constant weight codes
Author :
Gripon, Vincent ; Berrou, Claude
Author_Institution :
Electron. & Comput. Enginering, McGill Univ., Montreal, QC, Canada
Abstract :
A new family of sparse neural networks achieving nearly optimal performance has been recently introduced. In these networks, messages are stored as cliques in clustered graphs. In this paper, we interpret these networks using the formalism of error correcting codes. To achieve this, we introduce two original codes, the thrifty code and the clique code, that are both sub-families of binary constant weight codes. We also provide the networks with an enhanced retrieving rule that enables a property of answer correctness and that improves performance.
Keywords :
binary codes; content-addressable storage; error correction codes; graphs; neural nets; binary constant weight codes; clique code; clustered graphs; distributed constant weight codes; error correcting codes; nearly-optimal associative memories; sparse neural networks; thrifty code; Associative memory; Computer architecture; Decoding; Error correction codes; Hamming distance; Neural networks; Neurons; associative memory; classification; clique code; constant weight codes; sparse neural networks; thrifty code; winner-take-all;
Conference_Titel :
Information Theory and Applications Workshop (ITA), 2012
Conference_Location :
San Diego, CA
Print_ISBN :
978-1-4673-1473-2
DOI :
10.1109/ITA.2012.6181790