DocumentCode
1315935
Title
Redundancy rates for renewal and other processes
Author
Csiszár, Imre ; Shields, Paul C.
Author_Institution
Math. Inst., Hungarian Acad. of Sci., Budapest, Hungary
Volume
42
Issue
6
fYear
1996
fDate
11/1/1996 12:00:00 AM
Firstpage
2065
Lastpage
2072
Abstract
Upper and lower bounds, both of order √n, are obtained on minimax redundancy of universal lossless codes for the class of renewal processes. This is the first example of an interesting model class with strong redundancy rate o(n) but not O(log n). For the same class, the nonexistence of weak-rate bounds of smaller order than √n is also shown. The methods extend to provide upper and lower redundancy rate bounds of order n(k+1)/(k+2) for the class of processes that are Markov renewal of order k. The weak-rate methods also extend to show the nonexistence of o(n) weak-rate bounds for the class of regenerative processes
Keywords
Markov processes; minimax techniques; redundancy; source coding; variable length codes; Markov renewal; lower bounds; redundancy rates; regenerative processes; renewal processes; universal fixed-to-variable rate lossless codes; upper bounds; weak-rate bounds; Binary sequences; Conferences; Entropy; Information theory; Length measurement; Minimax techniques; Parametric statistics; Particle measurements; Source coding; Upper bound;
fLanguage
English
Journal_Title
Information Theory, IEEE Transactions on
Publisher
ieee
ISSN
0018-9448
Type
jour
DOI
10.1109/18.556596
Filename
556596
Link To Document