DocumentCode
1245237
Title
Sequential codes, lossless compression of individual sequences, and Kolmogorov complexity
Author
Kieffer, John C. ; Yang, En-Hui
Author_Institution
Dept. of Electr. Eng., Minnesota Univ., Minneapolis, MN, USA
Volume
42
Issue
1
fYear
1996
fDate
1/1/1996 12:00:00 AM
Firstpage
29
Lastpage
39
Abstract
A general class of sequential codes for lossless compression of individual sequences on a finite alphabet is defined, including many types of codes that one would want to implement. The principal requirement for membership in the class is that the encoding and decoding operations be performable on a computer. The OPTA function for the class of codes is then considered, which is the function that assigns to each individual sequence the infimum of the rates at which the sequence can be compressed over this class of sequential codes. Two results about the OPTA function are obtained: (1) it is shown that any sequential code in the class compresses some individual sequence at a rate strictly greater than the rate for that sequence given by the OPTA function; and (2) it is shown that the OPTA function takes a value strictly greater than that of the Kolmogorov (1965) complexity rate function for some individual sequences
Keywords
channel capacity; computational complexity; data compression; functional analysis; sequential codes; sequential decoding; Kolmogorov complexity rate function; OPTA function; decoding; encoding; finite alphabet; lossless compression; sequence compression; sequential codes; Decoding; Encoding; Information theory; Mathematics; Performance loss;
fLanguage
English
Journal_Title
Information Theory, IEEE Transactions on
Publisher
ieee
ISSN
0018-9448
Type
jour
DOI
10.1109/18.481775
Filename
481775
Link To Document