Title :
Universal Coding on Infinite Alphabets: Exponentially Decreasing Envelopes
Author :
Bontemps, Dominique
Author_Institution :
Lab. de Math. d´´Orsay, Univ. Paris-Sud, Orsay, France
fDate :
3/1/2011 12:00:00 AM
Abstract :
This paper deals with the problem of universal lossless coding on a countable infinite alphabet. It focuses on some classes of sources defined by an envelope condition on the marginal distribution, namely exponentially decreasing envelope classes with exponent . The minimax redundancy of exponentially decreasing envelope classes is proved to be equivalent to . Then, an adaptive algorithm is proposed, whose maximum redundancy is equivalent to the minimax redundancy.
Keywords :
data compression; encoding; minimax techniques; redundancy; countable infinite alphabet; envelope condition; exponentially decreasing envelope; marginal distribution; minimax redundancy; universal lossless coding; Data compression; Encoding; Entropy; Measurement; Probability distribution; Redundancy; Upper bound; Adaptive compression; Bayes mixture; data compression; infinite countable alphabets; redundancy; universal coding;
Journal_Title :
Information Theory, IEEE Transactions on
DOI :
10.1109/TIT.2010.2103831