Title :
A fast learning algorithm of neural network for the training and recognition of the phonemes
Author :
Jiang, Minghu ; Pang, Hongmei ; Deng, Beixing ; Zong, Chengqing
Author_Institution :
Dept. of Chinese Language, Tsinghua Univ., Beijing, China
Abstract :
In order to improve the training speed of multilayer feedforward neural networks, we proposed and explored fast backpropagation (BP) algorithms by introducing the hybrid global optimization conjugate gradient algorithm for the dynamic learning rate. This was to overcome the BP learning problem which caused plunging into local minima or slow convergence. Our algorithm is of a higher recognition rate than that of the Polak-Ribieve conjugate gradient and conventional BP algorithms. It showed less training time, less complication and stronger robustness than the Fletcher-Reeves conjugate gradient and conventional BP algorithms for real speech data.
Keywords :
backpropagation; conjugate gradient methods; feedforward neural nets; multilayer perceptrons; optimisation; speech recognition; conjugate gradient algorithm; convergence; dynamic learning rate; fast backpropagation algorithms; fast neural network learning algorithm; hybrid global optimization; local minima; multilayer feedforward neural networks; phoneme recognition training; recognition rate; speech recognition; training speed increase; Automation; Computational linguistics; Content addressable storage; Data engineering; Gradient methods; Iterative algorithms; Multi-layer neural network; Natural languages; Neural networks; Pattern recognition;
Conference_Titel :
Intelligent Multimedia, Video and Speech Processing, 2004. Proceedings of 2004 International Symposium on
Print_ISBN :
0-7803-8687-6
DOI :
10.1109/ISIMP.2004.1434064