• DocumentCode
    1780290
  • Title

    Relations between information and estimation in scalar Lévy channels

  • Author

    Jiantao Jiao ; Venkat, Kartik ; Weissman, Tsachy

  • Author_Institution
    Electr. Eng., Stanford Univ., Stanford, CA, USA
  • fYear
    2014
  • fDate
    June 29 2014-July 4 2014
  • Firstpage
    2212
  • Lastpage
    2216
  • Abstract
    Fundamental relations between information and estimation have been established in the literature for the scalar Gaussian and Poisson channels. In this work, we demonstrate that such relations hold for a much larger class of observation models. We introduce the natural family of scalar Lévy channels where the distribution of the output conditioned on the input is infinitely divisible. For Lévy channels, we establish new representations relating the mutual information between the channel input and output to an optimal estimation loss, thereby unifying and considerably extending results from the Gaussian and Poissonian settings. We demonstrate the richness of our results by working out two examples of Lévy channels, namely the Gamma channel and the Negative Binomial channel, with corresponding relations between information and estimation. Extensions to the setting of mismatched estimation are also presented.
  • Keywords
    Gaussian channels; Poisson distribution; binomial distribution; estimation theory; Poisson channels; channel input; channel output; gamma channel; information-estimation relations; mismatched estimation; mutual information; negative binomial channel; observation models; optimal estimation loss; output distribution; scalar Gaussian channels; scalar Lévy channels; Channel estimation; Entropy; Estimation; Mutual information; Random variables; Signal to noise ratio;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Information Theory (ISIT), 2014 IEEE International Symposium on
  • Conference_Location
    Honolulu, HI
  • Type

    conf

  • DOI
    10.1109/ISIT.2014.6875226
  • Filename
    6875226