Title :
Supervised Learning Using Spike-Timing-Dependent Plasticity of Memristive Synapses
Author :
Nishitani, Yu. ; Kaneko, Yukihiro ; Ueda, Michihito
Author_Institution :
Adv. Res. Div., Panasonic Corp., Kyoto, Japan
Abstract :
We propose a supervised learning model that enables error backpropagation for spiking neural network hardware. The method is modeled by modifying an existing model to suit the hardware implementation. An example of a network circuit for the model is also presented. In this circuit, a three-terminal ferroelectric memristor (3T-FeMEM), which is a field-effect transistor with a gate insulator composed of ferroelectric materials, is used as an electric synapse device to store the analog synaptic weight. Our model can be implemented by reflecting the network error to the write voltage of the 3T-FeMEMs and introducing a spike-timing-dependent learning function to the device. An XOR problem was successfully demonstrated as a benchmark learning by numerical simulations using the circuit properties to estimate the learning performance. In principle, the learning time per step of this supervised learning model and the circuit is independent of the number of neurons in each layer, promising a high-speed and low-power calculation in large-scale neural networks.
Keywords :
backpropagation; ferroelectric materials; field effect transistors; insulators; memristors; neural nets; 3T-FeMEM; XOR problem; analog synaptic weight; benchmark learning; circuit properties; electric synapse device; error backpropagation; ferroelectric materials; field-effect transistor; gate insulator; large-scale neural networks; learning performance estimation; memristive synapses; network circuit; numerical simulations; spike-timing-dependent learning function; spike-timing-dependent plasticity; spiking neural network hardware; supervised learning model; three-terminal ferroelectric memristor; Biological neural networks; Hardware; Logic gates; Memristors; Neurons; Supervised learning; Timing; Memristor; spike-timing-dependent plasticity (STDP); spiking neural network (SNN) hardware; supervised learning; supervised learning.;
Journal_Title :
Neural Networks and Learning Systems, IEEE Transactions on
DOI :
10.1109/TNNLS.2015.2399491