DocumentCode :
1343227
Title :
Simplistic universal coding
Author :
Neuhoff, David L. ; Shields, Paul C.
Author_Institution :
Dept. of Electr. Eng. & Comput. Sci., Michigan Univ., Ann Arbor, MI, USA
Volume :
44
Issue :
2
fYear :
1998
fDate :
3/1/1998 12:00:00 AM
Firstpage :
778
Lastpage :
781
Abstract :
A conceptually simple coding method may be described as follows. The source sequence is parsed into fixed-length blocks and a list of these blocks is placed in a dictionary. In the lossless case, the dictionary is transmitted and each successive block is encoded by giving its dictionary location. In the lossy case, the smallest collection of blocks such that every member of the dictionary is within distortion δ of the collection is determined, this codebook is transmitted, and each successive block is encoded by giving the location of a member of the code within δ of it. We show that by optimizing on the block length, this method is universal, that is, for any ergodic process it achieves entropy in the limit in the lossless case and the rate-distortion function R(δ) in the lossy case
Keywords :
block codes; entropy; rate distortion theory; source coding; block codes; block length optimisation; codebook; dictionary location; entropy rate; ergodic process; fixed-length blocks; lossless theorem; lossy theorem; rate-distortion function; source sequence; successive block encoding; universal coding; Convergence; Entropy; Information theory; Jacobian matrices; Mathematical model; Random variables; Read only memory; Sufficient conditions; Upper bound; Welding;
fLanguage :
English
Journal_Title :
Information Theory, IEEE Transactions on
Publisher :
ieee
ISSN :
0018-9448
Type :
jour
DOI :
10.1109/18.661520
Filename :
661520
Link To Document :
بازگشت