• DocumentCode
    1728466
  • Title

    Nearly-optimal associative memories based on distributed constant weight codes

  • Author

    Gripon, Vincent ; Berrou, Claude

  • Author_Institution
    Electron. & Comput. Enginering, McGill Univ., Montreal, QC, Canada
  • fYear
    2012
  • Firstpage
    269
  • Lastpage
    273
  • Abstract
    A new family of sparse neural networks achieving nearly optimal performance has been recently introduced. In these networks, messages are stored as cliques in clustered graphs. In this paper, we interpret these networks using the formalism of error correcting codes. To achieve this, we introduce two original codes, the thrifty code and the clique code, that are both sub-families of binary constant weight codes. We also provide the networks with an enhanced retrieving rule that enables a property of answer correctness and that improves performance.
  • Keywords
    binary codes; content-addressable storage; error correction codes; graphs; neural nets; binary constant weight codes; clique code; clustered graphs; distributed constant weight codes; error correcting codes; nearly-optimal associative memories; sparse neural networks; thrifty code; Associative memory; Computer architecture; Decoding; Error correction codes; Hamming distance; Neural networks; Neurons; associative memory; classification; clique code; constant weight codes; sparse neural networks; thrifty code; winner-take-all;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Information Theory and Applications Workshop (ITA), 2012
  • Conference_Location
    San Diego, CA
  • Print_ISBN
    978-1-4673-1473-2
  • Type

    conf

  • DOI
    10.1109/ITA.2012.6181790
  • Filename
    6181790