Title :
The minimum achievable redundancy rate of fixed-to-fixed length source codes for general sources
Author :
Arimura, Mitsuharu ; Iwata, Ken-ichi
Author_Institution :
Dept. of Appl. Comput. Sci., Shonan Inst. of Technol., Fujisawa, Japan
Abstract :
This paper investigates the minimum achievable redundancy rate of fixed-to-fixed length lossless source codes (FF codes) for general sources. This paper defines the redundancy rate of the FF code by the difference between the coding rate and the self information rate. We prove that the minimum achievable redundancy rate is equal to the limit superior in probability of the width of the information spectrum, which is defined in this paper. This paper also considers the ε-source coding. We show two criteria for bounding the error probability. The first one bounds the sum of the decoding error probability and the redundancy-overflow probability, and the other one bounds these two probabilities separately. We also give the minimum achievable redundancy rate of these two types of ε-source coding.
Keywords :
error statistics; redundancy; source coding; ε-source coding; coding rate; decoding error probability; flxed-to-flxed length lossless source codes; general sources; minimum achievable redundancy rate; redundancy-overflow probability; self information rate; Decoding; Entropy; Error probability; Manganese; Redundancy; Source coding;
Conference_Titel :
Information Theory and its Applications (ISITA), 2010 International Symposium on
Conference_Location :
Taichung
Print_ISBN :
978-1-4244-6016-8
Electronic_ISBN :
978-1-4244-6017-5
DOI :
10.1109/ISITA.2010.5649717