• DocumentCode
    1443039
  • Title

    The redundancy of source coding with a fidelity criterion .II. Coding at a fixed rate level with unknown statistics

  • Author

    Yang, En-Hui ; Zhang, Zhen

  • Author_Institution
    Dept. of Electr. & Comput. Eng., Waterloo Univ., Ont., Canada
  • Volume
    47
  • Issue
    1
  • fYear
    2001
  • fDate
    1/1/2001 12:00:00 AM
  • Firstpage
    126
  • Lastpage
    145
  • Abstract
    The redundancy problem of universal lossy source coding at a fixed rate level is considered. Under some condition on the single-letter distortion measure, which implies that the cardinality K of the reproduction alphabet is not greater than the cardinality J of the source alphabet, it is shown that the redundancy of universally coding memoryless sources p by nth-order block codes of rate R goes like |(∂/∂R)d(p,R)|Kln n/2n+o(ln n/n) for all memoryless sources p except a set whose volume goes to 0 as the block length n goes to infinity, where d(p,R) denotes the distortion rate function of p. Specifically, for any sequence {Cn}n=1 of block codes, where Cn is an nth-order block code at the fixed rate R, and any ε>0, the redundancy Dn(C n,p) of Cn for p is greater than or equal to |(∂/∂R)d(p,R)|(K-ε)ln n/2n for all p satisfying some regular conditions except a set whose volume goes to 0 as n→∞. On the other hand, there exists a sequence {Cn}n=1 of block codes at the rate R such that for any p satisfying some regular conditions, the super limit of Dn(Cn,p)|(ln n/n) is less than or equal to |(∂/∂R)d(p,R)|K/2
  • Keywords
    block codes; memoryless systems; rate distortion theory; source coding; statistical analysis; block codes; block length; cardinality; code rate; distortion rate function; fidelity criterion; fixed rate coding; memoryless sources; regular conditions; reproduction alphabet; sequence; single-letter distortion measure; source alphabet; source coding redundancy; universal lossy source coding; unknown statistics; Block codes; Distortion measurement; H infinity control; Length measurement; Performance loss; Rate distortion theory; Rate-distortion; Source coding; Statistics; Volume measurement;
  • fLanguage
    English
  • Journal_Title
    Information Theory, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9448
  • Type

    jour

  • DOI
    10.1109/18.904517
  • Filename
    904517