Title :
High performance associative memory with distance based training algorithm for character recognition
Author :
Seow, Ming-Jung ; Asari, Vijayan K.
Author_Institution :
Dept. of Electr. & Comput. Univ., Old Dominion Univ., Norfolk, VA, USA
Abstract :
The consequence of reducing the impact of the synaptic weights from neurons farther away from the neuron under consideration on a modular two-dimensional Hopfield network using Hebbian learning rule is examined for image processing applications. A generalized modular architecture is developed by defining each module with a group of neighboring neurons and all modules communicating with each other. A spatially decaying distance factor is introduced into the Hebbian rule to reduce the effect of neurons from farther modules. A biologically inspired visual perception concept has been adopted for defining the variation of the distance factor. The performance of the new technique is evaluated by conducting several experiments on character images and it is observed that the proposed method increases the learning ability and convergence rate of the network. The nature of the distance factor helps the removal of several synaptic weights farther away from a particular neuron and this leads to the reduction of complexity of the network in terms of both software and hardware implementation.
Keywords :
Hebbian learning; Hopfield neural nets; character recognition; content-addressable storage; convergence; Hebbian learning rule; biologically inspired visual perception concept; character recognition; distance based training algorithm; distance factor variation; generalized modular architecture; high performance associative memory; impact reduction; learning ability; modular two-dimensional Hopfield network; network convergence rate; neuron synaptic weights; spatially decaying distance factor; synaptic weight removal; Application software; Associative memory; Biological neural networks; Character recognition; Computer networks; Convergence; Electronic mail; Hopfield neural networks; Image processing; Neurons;
Conference_Titel :
Neural Networks, 2003. Proceedings of the International Joint Conference on
Print_ISBN :
0-7803-7898-9
DOI :
10.1109/IJCNN.2003.1223860