Title :
Convergence of hybrid algorithm with adaptive learning parameter for multilayer neural network
Author :
Damak, Fadwa ; Chtourou, Mohamed ; Ben Nasr, Mounir
Author_Institution :
Dept. of Electr. Eng., ENIS, Sfax, Tunisia
Abstract :
A new learning algorithm suited for training multilayered neural networks that we have named hybrid is hereby introduced. With this algorithm the weights of the hidden layer are adjusted using the Kohonen algorithm. While the weights of the output layer are trained using a gradient descent method with adaptive learning parameter based Lyapunov function. The effectiveness of the proposed approach is shown by the simulation results.
Keywords :
Lyapunov methods; gradient methods; learning (artificial intelligence); self-organising feature maps; Kohonen algorithm; Lyapunov function; adaptive learning parameter; gradient descent method; hybrid algorithm; multilayered neural networks training; Adaptive systems; Biological neural networks; Convergence; Feedforward neural networks; Neurons; Training; Adaptive learning rate; Feedforward; Hybrid training; Lyapunov theory; neural network;
Conference_Titel :
Computer and Information Technology (WCCIT), 2013 World Congress on
Conference_Location :
Sousse
Print_ISBN :
978-1-4799-0460-0
DOI :
10.1109/WCCIT.2013.6618677