• DocumentCode
    1299685
  • Title

    Hidden Markov Models with Nonelliptically Contoured State Densities

  • Author

    Chatzis, Sotirios P.

  • Author_Institution
    Dept. of Electr. & Electron. Eng., Imperial Coll. London, London, UK
  • Volume
    32
  • Issue
    12
  • fYear
    2010
  • Firstpage
    2297
  • Lastpage
    2304
  • Abstract
    Hidden Markov models (HMMs) are a popular approach for modeling sequential data comprising continuous attributes. In such applications, the observation emission densities of the HMM hidden states are typically modeled by means of elliptically contoured distributions, usually multivariate Gaussian or Student´s-t densities. However, elliptically contoured distributions cannot sufficiently model heavy-tailed or skewed populations which are typical in many fields, such as the financial and the communication signal processing domain. Employing finite mixtures of such elliptically contoured distributions to model the HMM state densities is a common approach for the amelioration of these issues. Nevertheless, the nature of the modeled data often requires postulation of a large number of mixture components for each HMM state, which might have a negative effect on both model efficiency and the training data set´s size required to avoid overfitting. To resolve these issues, in this paper, we advocate for the utilization of a nonelliptically contoured distribution, the multivariate normal inverse Gaussian (MNIG) distribution, for modeling the observation densities of HMMs. As we experimentally demonstrate, our selection allows for more effective modeling of skewed and heavy-tailed populations in a simple and computationally efficient manner.
  • Keywords
    Gaussian processes; hidden Markov models; HMM state density; MNIG distribution; communication signal processing domain; elliptically contoured distributions; hidden Markov models; multivariate Gaussian; multivariate normal inverse Gaussian; nonelliptically contoured distribution; nonelliptically contoured state densities; observation emission density; overfitting; sequential data; skewed populations; Computational modeling; Covariance matrix; Data models; Gaussian distribution; Hidden Markov models; Markov processes; Sequential diagnosis; Hidden Markov models; expectation-maximization; multivariate normal inverse Gaussian (MNIG) distribution; sequential data modeling.;
  • fLanguage
    English
  • Journal_Title
    Pattern Analysis and Machine Intelligence, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0162-8828
  • Type

    jour

  • DOI
    10.1109/TPAMI.2010.153
  • Filename
    5551154