Title :
A new back-propagation algorithm with coupled neuron
Author :
Fukumi, Minoru ; Omatu, Sigeru
Author_Institution :
Dept. of Inf. Sci. & Intelligent Syst., Tokushima Univ., Japan
fDate :
9/1/1991 12:00:00 AM
Abstract :
A novel neuron model and its learning algorithm are presented. They provide a novel approach for speeding up convergence in the learning of layered neural networks and for training networks of neurons with a nondifferentiable output function by using the gradient descent method. The neuron is called a saturating linear coupled neuron (sl-CONE). From simulation results, it is shown that the sl-CONE has a high convergence rate in learning compared with the conventional backpropagation algorithm
Keywords :
convergence of numerical methods; learning systems; neural nets; backpropagation; convergence; gradient descent method; learning algorithm; neural networks; neuron model; saturating linear coupled neuron; sl-CONE; Artificial neural networks; Character recognition; Convergence; Feedforward neural networks; Learning systems; Multi-layer neural network; Neural networks; Neurons; Optimization methods; Pattern recognition;
Journal_Title :
Neural Networks, IEEE Transactions on