Title :
Analogical mapping and inference with binary spatter codes and sparse distributed memory
Author :
Emruli, Blerim ; Gayler, Ross W. ; Sandin, Fredrik
Author_Institution :
EISLAB, Lulea Univ. of Technol., Lulea, Sweden
Abstract :
Analogy-making is a key function of human cognition. Therefore, the development of computational models of analogy that automatically learn from examples can lead to significant advances in cognitive systems. Analogies require complex, relational representations of learned structures, which is challenging for both symbolic and neurally inspired models. Vector symbolic architectures (VSAs) are a class of connectionist models for the representation and manipulation of compositional structures, which can be used to model analogy. We study a novel VSA network for the analogical mapping of compositional structures, which integrates an associative memory known as sparse distributed memory (SDM). The SDM enables non-commutative binding of compositional structures, which makes it possible to predict novel patterns in sequences. To demonstrate this property we apply the network to a commonly used intelligence test called Raven´s Progressive Matrices. We present results of simulation experiments for the Raven´s task and calculate the probability of prediction error at 95% confidence level. We find that non-commutative binding requires sparse activation of the SDM and that 10-20% concept-specific activation of neurons is optimal. The optimal dimensionality of the binary distributed representations of the VSA is of the order 104, which is comparable with former results and the average synapse count of neurons in the cerebral cortex.
Keywords :
cognition; distributed memory systems; inference mechanisms; probability; vectors; Raven progressive matrices; SDM; VSA; analogical mapping; analogy making; binary spatter codes; cerebral cortex; cognitive systems; human cognition; inference; probability; sparse distributed memory; vector symbolic architectures; Brain models; Computational modeling; Computer architecture; Neurons; Radiation detectors; Vectors;
Conference_Titel :
Neural Networks (IJCNN), The 2013 International Joint Conference on
Conference_Location :
Dallas, TX
Print_ISBN :
978-1-4673-6128-6
DOI :
10.1109/IJCNN.2013.6706829