DocumentCode
934562
Title
Exponential rate of convergence for Lloyd´s method I
Author
Kieffer, John B.
Volume
28
Issue
2
fYear
1982
fDate
3/1/1982 12:00:00 AM
Firstpage
205
Lastpage
210
Abstract
For a random variable with finite second moment and log-concave density, a unique quantizer exists which produces the minimum expected encoding error, using squared-error distortion. An algorithm given by Lloyd (Lloyd\´s Method I) yields a sequence of quantizers which converges to the optimum quantizer. Using results of Fleischer, it is shown that the convergence takes place exponentially fast if the logarithm of the density is not piecewise affine. As a consequence the number of iterations of Lloyd\´s algorithm needed to obtain the optimum distortion correct to n decimal places approaches infinity no faster than linearly in
. Another consequence is that if the output of a stationary information source at each time is distributed according to the given density, the source output can be encoded at each time
using the quantizer obtained on the
th iteration of Lloyd\´s method obtaining the same asymptotic behavior one would have obtained if the optimum quantizer had been used to encode at each time.
. Another consequence is that if the output of a stationary information source at each time is distributed according to the given density, the source output can be encoded at each time
using the quantizer obtained on the
th iteration of Lloyd\´s method obtaining the same asymptotic behavior one would have obtained if the optimum quantizer had been used to encode at each time.Keywords
Quantization (signal); Signal quantization; Algorithm design and analysis; Clustering algorithms; Convergence; Encoding; IEEE Transactions on Communications; Probability; Quantization; Random variables; Statistical distributions; Statistics;
fLanguage
English
Journal_Title
Information Theory, IEEE Transactions on
Publisher
ieee
ISSN
0018-9448
Type
jour
DOI
10.1109/TIT.1982.1056482
Filename
1056482
Link To Document