Title :
Mutual Information and Conditional Mean Estimation in Poisson Channels
Author :
Dongning Guo ; Shamai, Shlomo ; Verdu, S.
Author_Institution :
Northwestern Univ., Evanston
fDate :
5/1/2008 12:00:00 AM
Abstract :
Following the discovery of a fundamental connection between information measures and estimation measures in Gaussian channels, this paper explores the counterpart of those results in Poisson channels. In the continuous-time setting, the received signal is a doubly stochastic Poisson point process whose rate is equal to the input signal plus a dark current. It is found that, regardless of the statistics of the input, the derivative of the input-output mutual information with respect to the intensity of the additive dark current can be expressed as the expected difference between the logarithm of the input and the logarithm of its noncausal conditional mean estimate. The same holds for the derivative with respect to input scaling, but with the logarithmic function replaced by x log x. Similar relationships hold for discrete-time versions of the channel where the outputs are Poisson random variables conditioned on the input symbols.
Keywords :
Gaussian channels; Poisson distribution; channel estimation; random processes; Gaussian channel; Poisson channel; Poisson random variable; additive dark current; conditional mean estimation; doubly stochastic Poisson point process; information measure; input-output mutual information; logarithmic function; noncausal conditional mean estimate; Dark current; Filtering; Gaussian noise; Mutual information; Random variables; Signal detection; Signal processing; Signal to noise ratio; Stochastic processes; Stochastic resonance; Mutual information; Poisson process; nonlinear filtering; optimal estimation; point process; smoothing;
Journal_Title :
Information Theory, IEEE Transactions on
DOI :
10.1109/TIT.2008.920206