Title :
On the asymptotic redundancy of lossless block coding with two codeword lengths
Author :
Figueroa, Enrique ; Houdré, Christian
Author_Institution :
Dept. of Math., Purdue Univ., West Lafayette, IN, USA
Abstract :
With the additional constraint of requiring only two codeword lengths, lossless codes of blocks of size n generated by stationary memoryless binary sources are studied. For arbitrary δ>0, classical large-deviation inequalities imply the existence of codes attaining an expected redundancy of the order O(n-12+δ/). It is shown that it is not possible to construct lossless codes with two codeword lengths having rate of order better or equal to O(n-12/).
Keywords :
block codes; redundancy; Chernoff-Hoeffding inequalities; Shannon theory; asymptotic redundancy; classical large-deviation inequalities; codeword lengths; lossless block coding; stationary memoryless binary sources; Block codes; Convergence; Decoding; Distribution functions; Entropy; Estimation theory; Mathematics; Random variables;
Journal_Title :
Information Theory, IEEE Transactions on
DOI :
10.1109/TIT.2004.840858