DocumentCode
943683
Title
The source coding theorem via Sanov´s theorem (Corresp.)
Author
Bucklew, James
Volume
33
Issue
6
fYear
1987
fDate
11/1/1987 12:00:00 AM
Firstpage
907
Lastpage
909
Abstract
A proof of Shannon´s source coding theorem is given using results from large deviation theory. In particular Sanov´s theorem on convergence rates for empirical distributions is invoked to obtain the key large deviation result. This result is used directly to prove the source coding theorem for discrete memoryless sources. It is then shown how this theorem can be extended to ergodic Polish space valued sources and continuous distortion measures.
Keywords
Probability; Source coding; Channel coding; Convergence; Distortion measurement; Extraterrestrial measurements; Information theory; Rate distortion theory; Rate-distortion; Skeleton; Source coding;
fLanguage
English
Journal_Title
Information Theory, IEEE Transactions on
Publisher
ieee
ISSN
0018-9448
Type
jour
DOI
10.1109/TIT.1987.1057382
Filename
1057382
Link To Document