DocumentCode
1424617
Title
The Kolmogorov complexity, universal distribution, and coding theorem for generalized length functions
Author
Kobayashi, Kojiro
Author_Institution
Dept. of Math. & Comput. Sci., Tokyo Inst. of Technol., Japan
Volume
43
Issue
3
fYear
1997
fDate
5/1/1997 12:00:00 AM
Firstpage
816
Lastpage
826
Abstract
A function h(w) is said to be useful for the coding theorem if the coding theorem remains to be true when the lengths |w| of codewords w in it are replaced with h(w). For a codeword w=a0a1...am-1 of length m and an infinite sequence Q=(q0, q1, q2, ...) of real numbers such that 0<qn⩽½, let |w|Q denote the value Σn=0m-1 (if an =0 then -log2qn, else -log2(1-q n)), that is, -log2, (the probability that flippings of coins generate x) assuming that the (i+1)th coin generates a tail (or 0) with probability qi. It is known that if 0<lim infn→∞ qn then |w|Q is useful for the coding theorem and if limn→∞ q n/(1/(2n))=0 then |w|Q is not useful. We introduce several variations of the coding theorem and show sufficient conditions for h(w) not to be useful for these variations. The usefulness is also defined for the expressions that define the Kolmogorov complexity and the universal distribution. We consider the relation among the usefulness for the coding theorem, that for the Kolmogorov complexity, and that for the universal distribution
Keywords
computational complexity; encoding; functions; sequences; statistical analysis; Kolmogorov complexity; codewords; coding theorem; coin flipping; generalized length functions; infinite sequence; probability; real numbers; sufficient conditions; universal distribution; Codes; Costs; Sufficient conditions; Tail;
fLanguage
English
Journal_Title
Information Theory, IEEE Transactions on
Publisher
ieee
ISSN
0018-9448
Type
jour
DOI
10.1109/18.568693
Filename
568693
Link To Document