• DocumentCode
    943683
  • Title

    The source coding theorem via Sanov´s theorem (Corresp.)

  • Author

    Bucklew, James

  • Volume
    33
  • Issue
    6
  • fYear
    1987
  • fDate
    11/1/1987 12:00:00 AM
  • Firstpage
    907
  • Lastpage
    909
  • Abstract
    A proof of Shannon´s source coding theorem is given using results from large deviation theory. In particular Sanov´s theorem on convergence rates for empirical distributions is invoked to obtain the key large deviation result. This result is used directly to prove the source coding theorem for discrete memoryless sources. It is then shown how this theorem can be extended to ergodic Polish space valued sources and continuous distortion measures.
  • Keywords
    Probability; Source coding; Channel coding; Convergence; Distortion measurement; Extraterrestrial measurements; Information theory; Rate distortion theory; Rate-distortion; Skeleton; Source coding;
  • fLanguage
    English
  • Journal_Title
    Information Theory, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9448
  • Type

    jour

  • DOI
    10.1109/TIT.1987.1057382
  • Filename
    1057382