Title :
Simplistic universal coding
Author :
Neuhoff, David L. ; Shields, Paul C.
Author_Institution :
Dept. of Electr. Eng. & Comput. Sci., Michigan Univ., Ann Arbor, MI, USA
fDate :
3/1/1998 12:00:00 AM
Abstract :
A conceptually simple coding method may be described as follows. The source sequence is parsed into fixed-length blocks and a list of these blocks is placed in a dictionary. In the lossless case, the dictionary is transmitted and each successive block is encoded by giving its dictionary location. In the lossy case, the smallest collection of blocks such that every member of the dictionary is within distortion δ of the collection is determined, this codebook is transmitted, and each successive block is encoded by giving the location of a member of the code within δ of it. We show that by optimizing on the block length, this method is universal, that is, for any ergodic process it achieves entropy in the limit in the lossless case and the rate-distortion function R(δ) in the lossy case
Keywords :
block codes; entropy; rate distortion theory; source coding; block codes; block length optimisation; codebook; dictionary location; entropy rate; ergodic process; fixed-length blocks; lossless theorem; lossy theorem; rate-distortion function; source sequence; successive block encoding; universal coding; Convergence; Entropy; Information theory; Jacobian matrices; Mathematical model; Random variables; Read only memory; Sufficient conditions; Upper bound; Welding;
Journal_Title :
Information Theory, IEEE Transactions on