• DocumentCode
    2884963
  • Title

    Relative entropy at the channel output of a capacity-achieving code

  • Author

    Polyanskiy, Yury ; Verdú, Sergio

  • Author_Institution
    Dept. of Electr. Eng. & Comput. Sci., MIT, Cambridge, MA, USA
  • fYear
    2011
  • fDate
    28-30 Sept. 2011
  • Firstpage
    52
  • Lastpage
    59
  • Abstract
    In this paper we establish a new inequality tying together the coding rate, the probability of error and the relative entropy between the channel and the auxiliary output distribution. This inequality is then used to show the strong converse, and to prove that the output distribution of a code must be close, in relative entropy, to the capacity achieving output distribution (for DMC and AWGN). One of the key tools in our analysis is the concentration of measure (isoperimetry).
  • Keywords
    channel capacity; channel coding; auxiliary output distribution; capacity-achieving code; channel output; relative entropy; AWGN; Entropy; Manganese; Memoryless systems; Mutual information; Random variables; USA Councils; Shannon theory; additive white Gaussian noise; concentration of measure; discrete memoryless channels; empirical output statistics; general channels; information measures; strong converse;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Communication, Control, and Computing (Allerton), 2011 49th Annual Allerton Conference on
  • Conference_Location
    Monticello, IL
  • Print_ISBN
    978-1-4577-1817-5
  • Type

    conf

  • DOI
    10.1109/Allerton.2011.6120149
  • Filename
    6120149