Title :
Improved margin multi-class classification using dendritic neurons with morphological learning
Author :
Hussain, Shiraz ; Shih-Chii Liu ; Basu, Anirban
Author_Institution :
Sch. of Electr. & Electron. Eng., Nanyang Technol. Univ., Singapore, Singapore
Abstract :
We present an architecture of a spike based multiclass classifier using neurons with non-linear dendrites and sparse synaptic connectivity where each synapse takes a binary value. The learning in this model happens not through weight updates but through structural changes, i.e. a change of connectivity between inputs and dendrites. Hence, it is well suited for implementation in neuromorphic systems using address event representation (AER). We present a new learning rule that allows better generalization of the system to noisy testing data making it feasible to transfer learnt weights in software to a hardware device interfacing with noisy spiking sensors. The new rule improves testing accuracy by 7 - 10% compared to earlier versions. We also present preliminary results for multi-class classification on handwritten digits from the MNIST database and show that our system can attain comparable performance (≈ 3% more error) with other reported spike based classifiers while using at least 50% less synaptic resources.
Keywords :
learning (artificial intelligence); neural nets; pattern classification; AER; MNIST database; address event representation; dendritic neurons; handwritten digits; learning rule; margin multiclass classification; morphological learning; neuromorphic systems; noisy spiking sensors; nonlinear dendrites; sparse synaptic connectivity; spike based multiclass classifier; system generalization; Accuracy; Computer architecture; Microprocessors; Neurons; Testing; Training; Vectors;
Conference_Titel :
Circuits and Systems (ISCAS), 2014 IEEE International Symposium on
Conference_Location :
Melbourne VIC
Print_ISBN :
978-1-4799-3431-7
DOI :
10.1109/ISCAS.2014.6865715