Title :
Analyticity of entropy rate in families of hidden markov chains
Author :
Han, Guangyue ; Marcus, Brian
Author_Institution :
Dept. of Mathematics, British Columbia Univ., Vancouver, BC
Abstract :
We prove that under mild assumptions a hidden Markov chain varies analytically, in a strong sense, as a function of the underlying Markov chain parameters. In particular, we show that, under these assumptions, the entropy rate of a hidden Markov chain is an analytic function of the parameters. We give examples to show how this can fail in some cases. And we study two natural special classes of hidden Markov chains in more detail: binary hidden Markov chains with an unambiguous symbol and binary Markov chains corrupted by binary symmetric noise
Keywords :
binary codes; entropy codes; hidden Markov models; binary hidden Markov chains; binary symmetric noise; entropy rate; unambiguous symbol; Entropy; Failure analysis; Hidden Markov models; Integral equations; Mathematics; Stochastic processes;
Conference_Titel :
Information Theory, 2005. ISIT 2005. Proceedings. International Symposium on
Conference_Location :
Adelaide, SA
Print_ISBN :
0-7803-9151-9
DOI :
10.1109/ISIT.2005.1523736