• DocumentCode
    1424617
  • Title

    The Kolmogorov complexity, universal distribution, and coding theorem for generalized length functions

  • Author

    Kobayashi, Kojiro

  • Author_Institution
    Dept. of Math. & Comput. Sci., Tokyo Inst. of Technol., Japan
  • Volume
    43
  • Issue
    3
  • fYear
    1997
  • fDate
    5/1/1997 12:00:00 AM
  • Firstpage
    816
  • Lastpage
    826
  • Abstract
    A function h(w) is said to be useful for the coding theorem if the coding theorem remains to be true when the lengths |w| of codewords w in it are replaced with h(w). For a codeword w=a0a1...am-1 of length m and an infinite sequence Q=(q0, q1, q2, ...) of real numbers such that 0<qn⩽½, let |w|Q denote the value Σn=0m-1 (if an =0 then -log2qn, else -log2(1-q n)), that is, -log2, (the probability that flippings of coins generate x) assuming that the (i+1)th coin generates a tail (or 0) with probability qi. It is known that if 0<lim infn→∞ qn then |w|Q is useful for the coding theorem and if limn→∞ q n/(1/(2n))=0 then |w|Q is not useful. We introduce several variations of the coding theorem and show sufficient conditions for h(w) not to be useful for these variations. The usefulness is also defined for the expressions that define the Kolmogorov complexity and the universal distribution. We consider the relation among the usefulness for the coding theorem, that for the Kolmogorov complexity, and that for the universal distribution
  • Keywords
    computational complexity; encoding; functions; sequences; statistical analysis; Kolmogorov complexity; codewords; coding theorem; coin flipping; generalized length functions; infinite sequence; probability; real numbers; sufficient conditions; universal distribution; Codes; Costs; Sufficient conditions; Tail;
  • fLanguage
    English
  • Journal_Title
    Information Theory, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9448
  • Type

    jour

  • DOI
    10.1109/18.568693
  • Filename
    568693