Title :
A new approximate likelihood estimator for ARMA-filtered hidden Markov models
Author :
Michalek, Steffen ; Wagner, Mirko ; Timmer, Jens
Author_Institution :
Center for Data Anal. & Model Building, Freiburg Univ., Germany
fDate :
6/1/2000 12:00:00 AM
Abstract :
Hidden Markov models (HMMs) are successfully applied in various fields of time series analysis. Colored noise, e.g., due to filtering, violates basic assumptions of the model. Although it is well known how to consider autoregressive (AR) filtering, there is no algorithm to take into account moving-average (MA) filtering in parameter estimation exactly. We present an approximate likelihood estimator for MA-filtered HMM that is generalized to deal with an autoregressive moving-average (ARMA) filtered HMM. The approximation order of the likelihood calculation can be chosen. Therefore, we obtain a sequence of estimators for the HMM parameters as well as for the filter coefficients. The recursion equations for an efficient algorithm are derived from exact expressions for the forward iterations. By simulations, we show that the derived estimators are unbiased in filter situations where standard HMM´s are not able to recover the true dynamics. Special implementation strategies together with small approximations yield further acceleration of the algorithm
Keywords :
approximation theory; autoregressive moving average processes; filtering theory; hidden Markov models; maximum likelihood estimation; noise; time series; ARMA-filtered hidden Markov models; HMM; HMM parameters; MA-filtered HMM; algorithm acceleration; approximate likelihood estimator; approximation order; autoregressive filtering; autoregressive moving-average filtered HMM; colored noise; efficient algorithm; exact expressions; filter coefficients; filtering; forward iterations; hidden Markov models; moving-average filtering; parameter estimation; recursion equations; simulations; time series analysis; unbiased estimators; Colored noise; Equations; Filtering algorithms; Finite impulse response filter; Hidden Markov models; Nonlinear filters; Parameter estimation; Signal processing algorithms; Speech analysis; Time series analysis;
Journal_Title :
Signal Processing, IEEE Transactions on