Title :
Kraft Inequality and Zero-Error Source Coding With Decoder Side Information
Author_Institution :
Dept. of Electr. Eng., California Univ., Riverside, CA
Abstract :
For certain source coding problems, it is well known that the Kraft inequality provides a simple sufficient condition for the existence of codes with given codeword lengths. Motivated by this fact, a sufficient condition based on the Kraft inequality can also be sought for the problem of zero-error instantaneous coding with decoder side information. More specifically, it can be envisioned that a sufficient condition for the existence of such codes with codeword lengths {l x} is that for some 0<alphales<1 SigmaxepsivFscr (2-l x)lesalpha for each clique Fscr in the characteristic graph G of the source-side information pair. In this correspondence, it is shown that (1) if the above is indeed a sufficient condition for a class G of graphs, then it is possible to come as close as 1-log2 alpha bits to the asymptotic limits for each graph in G, (2) there exist graph classes of interest for which such a can indeed be found, and finally (3) no such n can be found for the class of all graphs.
Keywords :
decoding; graph theory; source coding; Kraft inequality; decoder side information; zero-error instantaneous coding; zero-error source coding; Application software; Bibliographies; Decoding; Entropy; Random number generation; Rivers; Source coding; Statistics; Sufficient conditions; Thermodynamics; Clique entropy; Kraft inequality; confusability graph; rectangle packing; redundancy; side information; zero-error;
Journal_Title :
Information Theory, IEEE Transactions on
DOI :
10.1109/TIT.2007.909161