Title :
The source coding theorem via Sanov´s theorem (Corresp.)
fDate :
11/1/1987 12:00:00 AM
Abstract :
A proof of Shannon´s source coding theorem is given using results from large deviation theory. In particular Sanov´s theorem on convergence rates for empirical distributions is invoked to obtain the key large deviation result. This result is used directly to prove the source coding theorem for discrete memoryless sources. It is then shown how this theorem can be extended to ergodic Polish space valued sources and continuous distortion measures.
Keywords :
Probability; Source coding; Channel coding; Convergence; Distortion measurement; Extraterrestrial measurements; Information theory; Rate distortion theory; Rate-distortion; Skeleton; Source coding;
Journal_Title :
Information Theory, IEEE Transactions on
DOI :
10.1109/TIT.1987.1057382