• DocumentCode
    395101
  • Title

    On discrete N-layer heteroassociative memory models

  • Author

    Waivio, Rodica

  • Author_Institution
    Dept. of Comput. Sci., Illinois Univ., Chicago, IL, USA
  • Volume
    1
  • fYear
    2002
  • fDate
    18-22 Nov. 2002
  • Firstpage
    60
  • Abstract
    In this paper we investigate computational properties of a new N-layer heteroassociative memory model with respect to information encoding. We describe a technique for encoding a set of m×n matrix patterns where entering one column (row) of a pattern allows the remaining columns (rows) to be recurrently reconstructed. Following are some of the main contributions of this paper: - We show how to transform any given set of patterns to a standard form using a simple procedure. Then we demonstrate that after a competitive initialization among all layers our multilayer network converges in one step to fixed points which are one of the given patterns in its standard form. Due to an increase in the domain of attraction, our architecture becomes more powerful than the previous models. - We analyze the optimal number of layers, as well as their dimensions, based on the cardinality of maximal linearly independent subspaces of the input patterns. - We prove that our proposed model is stable under mild technical assumptions using the discrete Lyapunov energy function.
  • Keywords
    content-addressable storage; matrix algebra; multilayer perceptrons; competitive initialization; computational properties; discrete Lyapunov energy function; discrete N-layer heteroassociative memory models; information encoding; matrix patterns; multilayer network; Associative memory; Biological system modeling; Computer architecture; Computer science; Encoding; Magnesium compounds; Neurons; Nonhomogeneous media; Pattern analysis; Power system modeling;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Neural Information Processing, 2002. ICONIP '02. Proceedings of the 9th International Conference on
  • Print_ISBN
    981-04-7524-1
  • Type

    conf

  • DOI
    10.1109/ICONIP.2002.1202131
  • Filename
    1202131