• DocumentCode
    747588
  • Title

    Universal redundancy rates for the class of B-processes do not exist

  • Author

    Shields, Paul ; Weiss, Benjamin

  • Author_Institution
    Dept. of Math., Toledo Univ., OH, USA
  • Volume
    41
  • Issue
    2
  • fYear
    1995
  • fDate
    3/1/1995 12:00:00 AM
  • Firstpage
    508
  • Lastpage
    512
  • Abstract
    Shows that for any sequence ρ(n)=o(n) and any sequence of prefix codes, there is a B-process of entropy arbitrarily close to the maximum possible entropy for which the expected redundancy is at least as large as ρ(n) for infinitely many n. This extends work of Shields (1993), whose examples had O entropy. The class of B-processes, that is, stationary codings of independent and identically distributed (i.i.d.) processes, includes the aperiodic Markov chains and functions thereof, aperiodic renewal and regenerative processes, and m-dependent processes, as well as many other processes of interest. In particular, the results show that the search for a universal redundancy rate for the class of all B-processes is doomed to failure, and redundancy rates for any given subclass must be obtained by direct analysis of that subclass
  • Keywords
    Markov processes; codes; entropy; redundancy; sequences; B-processes; aperiodic Markov chains; aperiodic renewal; entropy; iid processes; independent and identically distributed processes; m-dependent processes; maximum possible entropy; prefix codes; regenerative processes; sequence; stationary codings; universal redundancy rates; Entropy; Failure analysis; Information theory; Length measurement; Mathematics; Noise measurement;
  • fLanguage
    English
  • Journal_Title
    Information Theory, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9448
  • Type

    jour

  • DOI
    10.1109/18.370156
  • Filename
    370156