• DocumentCode
    934562
  • Title

    Exponential rate of convergence for Lloyd´s method I

  • Author

    Kieffer, John B.

  • Volume
    28
  • Issue
    2
  • fYear
    1982
  • fDate
    3/1/1982 12:00:00 AM
  • Firstpage
    205
  • Lastpage
    210
  • Abstract
    For a random variable with finite second moment and log-concave density, a unique quantizer exists which produces the minimum expected encoding error, using squared-error distortion. An algorithm given by Lloyd (Lloyd\´s Method I) yields a sequence of quantizers which converges to the optimum quantizer. Using results of Fleischer, it is shown that the convergence takes place exponentially fast if the logarithm of the density is not piecewise affine. As a consequence the number of iterations of Lloyd\´s algorithm needed to obtain the optimum distortion correct to n decimal places approaches infinity no faster than linearly in n . Another consequence is that if the output of a stationary information source at each time is distributed according to the given density, the source output can be encoded at each time i using the quantizer obtained on the i th iteration of Lloyd\´s method obtaining the same asymptotic behavior one would have obtained if the optimum quantizer had been used to encode at each time.
  • Keywords
    Quantization (signal); Signal quantization; Algorithm design and analysis; Clustering algorithms; Convergence; Encoding; IEEE Transactions on Communications; Probability; Quantization; Random variables; Statistical distributions; Statistics;
  • fLanguage
    English
  • Journal_Title
    Information Theory, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9448
  • Type

    jour

  • DOI
    10.1109/TIT.1982.1056482
  • Filename
    1056482