Title :
In Situ Training of CMOL CrossNets
Author :
Lee, Jung Hoon ; Likharev, Konstantin K.
Author_Institution :
Stony Brook Univ., Stony Brook
Abstract :
Hybrid semiconductor/nanodevice ("CMOL") technology may allow the implementation of digital and mixed-signal integrated circuits, including artificial neural networks ("CrossNets"), with unparalleled density and speed. However, previously suggested methods of CrossNet training may be impracticable for large-scale applications of these networks. In this work, we are describing two new methods of "in situ" training of CrossNets, based on either genuinely stochastic or pseudo-stochastic multiplication of analog signals, which may be readily implemented in CMOL circuits. The methods have been tested by numerical simulation of CrossNet-based perceptrons by error backpropagation on three problems of the Probenl benchmark dataset. The testing gave very encouraging results: CMOL CrossNets with their binary elementary synapses may provide, after the in situ training, classification performance at least on a par with the best results reported for software-based networks with continuous synaptic weights.
Keywords :
CMOS integrated circuits; backpropagation; benchmark testing; electronic engineering computing; monolithic integrated circuits; nanoelectronics; perceptrons; CMOL CrossNets; CMOL circuits; Probenl benchmark dataset; analog signals; artificial neural networks; digital-signal integrated circuits; error backpropagation; hybrid semiconductor; mixed-signal integrated circuits; nanodevice; numerical simulation; perceptrons; pseudo-stochastic multiplication; Artificial neural networks; Backpropagation; Benchmark testing; Circuit testing; Integrated circuit technology; Large-scale systems; Mixed analog digital integrated circuits; Numerical simulation; Software testing; Stochastic processes;
Conference_Titel :
Neural Networks, 2006. IJCNN '06. International Joint Conference on
Conference_Location :
Vancouver, BC
Print_ISBN :
0-7803-9490-9
DOI :
10.1109/IJCNN.2006.247180