DocumentCode
395101
Title
On discrete N-layer heteroassociative memory models
Author
Waivio, Rodica
Author_Institution
Dept. of Comput. Sci., Illinois Univ., Chicago, IL, USA
Volume
1
fYear
2002
fDate
18-22 Nov. 2002
Firstpage
60
Abstract
In this paper we investigate computational properties of a new N-layer heteroassociative memory model with respect to information encoding. We describe a technique for encoding a set of m×n matrix patterns where entering one column (row) of a pattern allows the remaining columns (rows) to be recurrently reconstructed. Following are some of the main contributions of this paper: - We show how to transform any given set of patterns to a standard form using a simple procedure. Then we demonstrate that after a competitive initialization among all layers our multilayer network converges in one step to fixed points which are one of the given patterns in its standard form. Due to an increase in the domain of attraction, our architecture becomes more powerful than the previous models. - We analyze the optimal number of layers, as well as their dimensions, based on the cardinality of maximal linearly independent subspaces of the input patterns. - We prove that our proposed model is stable under mild technical assumptions using the discrete Lyapunov energy function.
Keywords
content-addressable storage; matrix algebra; multilayer perceptrons; competitive initialization; computational properties; discrete Lyapunov energy function; discrete N-layer heteroassociative memory models; information encoding; matrix patterns; multilayer network; Associative memory; Biological system modeling; Computer architecture; Computer science; Encoding; Magnesium compounds; Neurons; Nonhomogeneous media; Pattern analysis; Power system modeling;
fLanguage
English
Publisher
ieee
Conference_Titel
Neural Information Processing, 2002. ICONIP '02. Proceedings of the 9th International Conference on
Print_ISBN
981-04-7524-1
Type
conf
DOI
10.1109/ICONIP.2002.1202131
Filename
1202131
Link To Document