• DocumentCode
    1315935
  • Title

    Redundancy rates for renewal and other processes

  • Author

    Csiszár, Imre ; Shields, Paul C.

  • Author_Institution
    Math. Inst., Hungarian Acad. of Sci., Budapest, Hungary
  • Volume
    42
  • Issue
    6
  • fYear
    1996
  • fDate
    11/1/1996 12:00:00 AM
  • Firstpage
    2065
  • Lastpage
    2072
  • Abstract
    Upper and lower bounds, both of order √n, are obtained on minimax redundancy of universal lossless codes for the class of renewal processes. This is the first example of an interesting model class with strong redundancy rate o(n) but not O(log n). For the same class, the nonexistence of weak-rate bounds of smaller order than √n is also shown. The methods extend to provide upper and lower redundancy rate bounds of order n(k+1)/(k+2) for the class of processes that are Markov renewal of order k. The weak-rate methods also extend to show the nonexistence of o(n) weak-rate bounds for the class of regenerative processes
  • Keywords
    Markov processes; minimax techniques; redundancy; source coding; variable length codes; Markov renewal; lower bounds; redundancy rates; regenerative processes; renewal processes; universal fixed-to-variable rate lossless codes; upper bounds; weak-rate bounds; Binary sequences; Conferences; Entropy; Information theory; Length measurement; Minimax techniques; Parametric statistics; Particle measurements; Source coding; Upper bound;
  • fLanguage
    English
  • Journal_Title
    Information Theory, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9448
  • Type

    jour

  • DOI
    10.1109/18.556596
  • Filename
    556596