Title :
Rapid Feedforward Computation by Temporal Encoding and Learning With Spiking Neurons
Author :
Qiang Yu ; Huajin Tang ; Tan, Kay Chen ; Haizhou Li
Author_Institution :
Dept. of Electr. & Comput. Eng., Nat. Univ. of Singapore, Singapore, Singapore
Abstract :
Primates perform remarkably well in cognitive tasks such as pattern recognition. Motivated by recent findings in biological systems, a unified and consistent feedforward system network with a proper encoding scheme and supervised temporal rules is built for solving the pattern recognition task. The temporal rules used for processing precise spiking patterns have recently emerged as ways of emulating the brain´s computation from its anatomy and physiology. Most of these rules could be used for recognizing different spatiotemporal patterns. However, there arises the question of whether these temporal rules could be used to recognize real-world stimuli such as images. Furthermore, how the information is represented in the brain still remains unclear. To tackle these problems, a proper encoding method and a unified computational model with consistent and efficient learning rule are proposed. Through encoding, external stimuli are converted into sparse representations, which also have properties of invariance. These temporal patterns are then learned through biologically derived algorithms in the learning layer, followed by the final decision presented through the readout layer. The performance of the model with images of digits from the MNIST database is presented. The results show that the proposed model is capable of recognizing images correctly with a performance comparable to that of current benchmark algorithms. The results also suggest a plausibility proof for a class of feedforward models of rapid and robust recognition in the brain.
Keywords :
brain; feedforward neural nets; image recognition; learning (artificial intelligence); MNIST database; anatomy; biological systems; biologically derived algorithms; brain; cognitive tasks; encoding scheme; feedforward models; feedforward system network; image recognition; learning layer; learning rule; physiology; precise spiking patterns; proper encoding method; rapid feedforward computation; real-world stimuli; sparse representations; spatiotemporal pattern recognition; spiking neurons; supervised temporal rules; temporal encoding; temporal patterns; unified computational model; Brain modeling; Computational modeling; Encoding; Feedforward neural networks; Neurons; Pattern recognition; Spatiotemporal phenomena; Pattern recognition; spatiotemporal patterns; spike-timing-dependent plasticity (STDP); spiking neural network (SNN); supervised learning; temporal encoding; temporal learning;
Journal_Title :
Neural Networks and Learning Systems, IEEE Transactions on
DOI :
10.1109/TNNLS.2013.2245677