Title :
Asymptotic redundancy of the MTF scheme for stationary ergodic sources
Author :
Arimura, Mitsuharu ; Yamamoto, Hirosuke
Author_Institution :
Dept. of Syst. & Commun. Eng., Shonan Inst. of Technol., Kanagawa, Japan
Abstract :
The Move-to-front (MTF) scheme is a data-compression method which converts each symbol of a source sequence to a positive integer sequentially, and encodes it to a binary codeword. The compression performance of this algorithm has been analyzed usually under the assumption of the so-called symbol extension. But, in this paper, upper and lower bounds are derived for the redundancy of the MTF scheme without the symbol extension for stationary ergodic sources and Markov sources. It is also proved that for the stationary ergodic first-order Markov sources, the MTF scheme can attain the entropy rate if and only if the transition matrix of the source is a kind of doubly stochastic matrix. Moreover, if the source is a Kth-order Markov source (K≥2), the MTF scheme cannot attain the entropy rate of the source generally.
Keywords :
Markov processes; data compression; entropy codes; matrix algebra; redundancy; sequential codes; source coding; MTF; MTF scheme; asymptotic redundancy; binary codeword; data-compression method; doubly stochastic matrix; entropy rate; first-order Markov source; move-to-front scheme; sequential positive integer; stationary ergodic source sequence; symbol extension; transition matrix; Algorithm design and analysis; Entropy; Helium; Information analysis; Information theory; Performance analysis; Source coding; Stochastic processes; Systems engineering and theory; Upper bound; Asymptotic redundancy; Markov sources; doubly stochastic process; move-to-front (MTF) scheme; stationary ergodic sources;
Journal_Title :
Information Theory, IEEE Transactions on
DOI :
10.1109/TIT.2005.856941