DocumentCode
1443039
Title
The redundancy of source coding with a fidelity criterion .II. Coding at a fixed rate level with unknown statistics
Author
Yang, En-Hui ; Zhang, Zhen
Author_Institution
Dept. of Electr. & Comput. Eng., Waterloo Univ., Ont., Canada
Volume
47
Issue
1
fYear
2001
fDate
1/1/2001 12:00:00 AM
Firstpage
126
Lastpage
145
Abstract
The redundancy problem of universal lossy source coding at a fixed rate level is considered. Under some condition on the single-letter distortion measure, which implies that the cardinality K of the reproduction alphabet is not greater than the cardinality J of the source alphabet, it is shown that the redundancy of universally coding memoryless sources p by nth-order block codes of rate R goes like |(∂/∂R)d(p,R)|Kln n/2n+o(ln n/n) for all memoryless sources p except a set whose volume goes to 0 as the block length n goes to infinity, where d(p,R) denotes the distortion rate function of p. Specifically, for any sequence {Cn}n=1∞ of block codes, where Cn is an nth-order block code at the fixed rate R, and any ε>0, the redundancy Dn(C n,p) of Cn for p is greater than or equal to |(∂/∂R)d(p,R)|(K-ε)ln n/2n for all p satisfying some regular conditions except a set whose volume goes to 0 as n→∞. On the other hand, there exists a sequence {Cn}n=1∞ of block codes at the rate R such that for any p satisfying some regular conditions, the super limit of Dn(Cn,p)|(ln n/n) is less than or equal to |(∂/∂R)d(p,R)|K/2
Keywords
block codes; memoryless systems; rate distortion theory; source coding; statistical analysis; block codes; block length; cardinality; code rate; distortion rate function; fidelity criterion; fixed rate coding; memoryless sources; regular conditions; reproduction alphabet; sequence; single-letter distortion measure; source alphabet; source coding redundancy; universal lossy source coding; unknown statistics; Block codes; Distortion measurement; H infinity control; Length measurement; Performance loss; Rate distortion theory; Rate-distortion; Source coding; Statistics; Volume measurement;
fLanguage
English
Journal_Title
Information Theory, IEEE Transactions on
Publisher
ieee
ISSN
0018-9448
Type
jour
DOI
10.1109/18.904517
Filename
904517
Link To Document