DocumentCode
1343227
Title
Simplistic universal coding
Author
Neuhoff, David L. ; Shields, Paul C.
Author_Institution
Dept. of Electr. Eng. & Comput. Sci., Michigan Univ., Ann Arbor, MI, USA
Volume
44
Issue
2
fYear
1998
fDate
3/1/1998 12:00:00 AM
Firstpage
778
Lastpage
781
Abstract
A conceptually simple coding method may be described as follows. The source sequence is parsed into fixed-length blocks and a list of these blocks is placed in a dictionary. In the lossless case, the dictionary is transmitted and each successive block is encoded by giving its dictionary location. In the lossy case, the smallest collection of blocks such that every member of the dictionary is within distortion δ of the collection is determined, this codebook is transmitted, and each successive block is encoded by giving the location of a member of the code within δ of it. We show that by optimizing on the block length, this method is universal, that is, for any ergodic process it achieves entropy in the limit in the lossless case and the rate-distortion function R(δ) in the lossy case
Keywords
block codes; entropy; rate distortion theory; source coding; block codes; block length optimisation; codebook; dictionary location; entropy rate; ergodic process; fixed-length blocks; lossless theorem; lossy theorem; rate-distortion function; source sequence; successive block encoding; universal coding; Convergence; Entropy; Information theory; Jacobian matrices; Mathematical model; Random variables; Read only memory; Sufficient conditions; Upper bound; Welding;
fLanguage
English
Journal_Title
Information Theory, IEEE Transactions on
Publisher
ieee
ISSN
0018-9448
Type
jour
DOI
10.1109/18.661520
Filename
661520
Link To Document