DocumentCode
2498482
Title
Alpha-EM gives fast Hidden Markov Model estimation: Derivation and evaluation of alpha-HMM
Author
Matsuyama, Yasuo ; Hayashi, Ryunosuke
Author_Institution
Dept. of Comput. Sci. & Eng., Waseda Univ., Tokyo, Japan
fYear
2010
fDate
18-23 July 2010
Firstpage
1
Lastpage
8
Abstract
A fast learning algorithm for Hidden Markov Models is derived starting from convex divergence optimization. This method utilizes the alpha-logarithm as a surrogate function for the traditional logarithm to process the likelihood ratio. This enables the utilization of a stronger curvature than the logarithm. This paper´s method includes the ordinary Baum-Welch re-estimation algorithm as a proper subset. The presented algorithm shows fast learning by utilizing time-shifted information during the progress of iterations. The computational complexity of this algorithm, which directly affects the CPU time, remains almost the same as the logarithmic one since only stored results are utilized for the speedup. Software implementation and speed are examined in the test data. The results showed that the presented method is creditable.
Keywords
computational complexity; convex programming; hidden Markov models; alpha-expectation-maximization algorithm; alpha-hidden Markov model; alpha-logarithm; computational complexity; convex divergence optimization; fast hidden Markov model estimation; fast learning algorithm; ordinary Baum-Welch re-estimation algorithm; surrogate function; Convergence; Equations; Estimation; Hidden Markov models; Markov processes; Mathematical model; Software algorithms;
fLanguage
English
Publisher
ieee
Conference_Titel
Neural Networks (IJCNN), The 2010 International Joint Conference on
Conference_Location
Barcelona
ISSN
1098-7576
Print_ISBN
978-1-4244-6916-1
Type
conf
DOI
10.1109/IJCNN.2010.5596959
Filename
5596959
Link To Document