DocumentCode
747588
Title
Universal redundancy rates for the class of B-processes do not exist
Author
Shields, Paul ; Weiss, Benjamin
Author_Institution
Dept. of Math., Toledo Univ., OH, USA
Volume
41
Issue
2
fYear
1995
fDate
3/1/1995 12:00:00 AM
Firstpage
508
Lastpage
512
Abstract
Shows that for any sequence ρ(n)=o(n) and any sequence of prefix codes, there is a B-process of entropy arbitrarily close to the maximum possible entropy for which the expected redundancy is at least as large as ρ(n) for infinitely many n. This extends work of Shields (1993), whose examples had O entropy. The class of B-processes, that is, stationary codings of independent and identically distributed (i.i.d.) processes, includes the aperiodic Markov chains and functions thereof, aperiodic renewal and regenerative processes, and m-dependent processes, as well as many other processes of interest. In particular, the results show that the search for a universal redundancy rate for the class of all B-processes is doomed to failure, and redundancy rates for any given subclass must be obtained by direct analysis of that subclass
Keywords
Markov processes; codes; entropy; redundancy; sequences; B-processes; aperiodic Markov chains; aperiodic renewal; entropy; iid processes; independent and identically distributed processes; m-dependent processes; maximum possible entropy; prefix codes; regenerative processes; sequence; stationary codings; universal redundancy rates; Entropy; Failure analysis; Information theory; Length measurement; Mathematics; Noise measurement;
fLanguage
English
Journal_Title
Information Theory, IEEE Transactions on
Publisher
ieee
ISSN
0018-9448
Type
jour
DOI
10.1109/18.370156
Filename
370156
Link To Document