DocumentCode :
1780346
Title :
Necessary and sufficient conditions for reliability of posterior matching in arbitrary dimensions
Author :
Rui Ma ; Coleman, Todd P.
Author_Institution :
Bioeng., UCSD, La Jolla, CA, USA
fYear :
2014
fDate :
June 29 2014-July 4 2014
Firstpage :
2366
Lastpage :
2370
Abstract :
The posterior matching (PM) scheme is a mutual information maximizing scheme for efficiently communicating a message point in a continuum over a noisy channel with feedback. It was recently developed when the message point was on a subset of the real line, and we more recently have generalized the framework to arbitrary dimensions with the theory of optimal transport. Although the PM scheme is guaranteed to maximize mutual information, in some situations it is not reliable (e.g. the posterior distribution does not converge to a point mass). Here, we show that the PM scheme is reliable if and only if the nonlinear filter of a certain hidden Markov model achieves maximal accuracy. We show that ergodicity of a random process pertaining to the channel input process is necessary for PM reliability. Lastly, we show that joint ergodicity of random processes pertaining to inputs and outputs of the channel is a sufficient condition for reliability. The latter results leverages optimal transport properties (invertibility) of the encoder map.
Keywords :
encoding; hidden Markov models; random processes; encoder map; hidden Markov model; mutual information maximization; noisy channel; nonlinear filter; optimal transport theory; posterior distribution; posterior matching reliability; random process; Accuracy; Hidden Markov models; Mutual information; Random processes; Reliability theory;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Information Theory (ISIT), 2014 IEEE International Symposium on
Conference_Location :
Honolulu, HI
Type :
conf
DOI :
10.1109/ISIT.2014.6875257
Filename :
6875257
Link To Document :
بازگشت