• DocumentCode
    2498482
  • Title

    Alpha-EM gives fast Hidden Markov Model estimation: Derivation and evaluation of alpha-HMM

  • Author

    Matsuyama, Yasuo ; Hayashi, Ryunosuke

  • Author_Institution
    Dept. of Comput. Sci. & Eng., Waseda Univ., Tokyo, Japan
  • fYear
    2010
  • fDate
    18-23 July 2010
  • Firstpage
    1
  • Lastpage
    8
  • Abstract
    A fast learning algorithm for Hidden Markov Models is derived starting from convex divergence optimization. This method utilizes the alpha-logarithm as a surrogate function for the traditional logarithm to process the likelihood ratio. This enables the utilization of a stronger curvature than the logarithm. This paper´s method includes the ordinary Baum-Welch re-estimation algorithm as a proper subset. The presented algorithm shows fast learning by utilizing time-shifted information during the progress of iterations. The computational complexity of this algorithm, which directly affects the CPU time, remains almost the same as the logarithmic one since only stored results are utilized for the speedup. Software implementation and speed are examined in the test data. The results showed that the presented method is creditable.
  • Keywords
    computational complexity; convex programming; hidden Markov models; alpha-expectation-maximization algorithm; alpha-hidden Markov model; alpha-logarithm; computational complexity; convex divergence optimization; fast hidden Markov model estimation; fast learning algorithm; ordinary Baum-Welch re-estimation algorithm; surrogate function; Convergence; Equations; Estimation; Hidden Markov models; Markov processes; Mathematical model; Software algorithms;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Neural Networks (IJCNN), The 2010 International Joint Conference on
  • Conference_Location
    Barcelona
  • ISSN
    1098-7576
  • Print_ISBN
    978-1-4244-6916-1
  • Type

    conf

  • DOI
    10.1109/IJCNN.2010.5596959
  • Filename
    5596959