• DocumentCode
    1412935
  • Title

    Optimal entropy-constrained scalar quantization of a uniform source

  • Author

    György, András ; Linder, Tamás

  • Author_Institution
    Dept. of Math. & Stat., Queen´´s Univ., Kingston, Ont., Canada
  • Volume
    46
  • Issue
    7
  • fYear
    2000
  • fDate
    11/1/2000 12:00:00 AM
  • Firstpage
    2704
  • Lastpage
    2711
  • Abstract
    Optimal scalar quantization subject to an entropy constraint is studied for a wide class of difference distortion measures including rth-power distortions with r>0. It is proved that if the source is uniformly distributed over an interval, then for any entropy constraint R (in nats), an optimal quantizer has N=[eR] interval cells such that N-1 cells have equal length d and one cell has length c⩽d. The cell lengths are uniquely determined by the requirement that the entropy constraint is satisfied with equality. Based on this result, a parametric representation of the minimum achievable distortion Dh (R) as a function of the entropy constraint R is obtained for a uniform source. The Dh(R) curve turns out to be nonconvex in general. Moreover, for the squared-error distortion it is shown that D h(R) is a piecewise-concave function, and that a scalar quantizer achieving the lower convex hull of Dh(R) exists only at rates R=log N, where N is a positive integer
  • Keywords
    entropy codes; rate distortion theory; source coding; variable length codes; cell lengths; difference distortion measures; entropy constraint; equality; minimum achievable distortion; nonconvex curve; optimal entropy-constrained scalar quantization; optimal quantizer; optimal scalar quantization; parametric representation; piecewise-concave function; rth-power distortions; squared-error distortion; uniform source; Decoding; Distortion measurement; Information rates; Information theory; Linear predictive coding; Mutual information; Rate distortion theory; Rate-distortion; Source coding; Vector quantization;
  • fLanguage
    English
  • Journal_Title
    Information Theory, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9448
  • Type

    jour

  • DOI
    10.1109/18.887885
  • Filename
    887885