Title :
Entropy Density and Mismatch in High-Rate Scalar Quantization With Rényi Entropy Constraint
Author :
Kreitmeier, Wolfgang ; Linder, Tamás
Author_Institution :
Dept. of Inf. & Math., Univ. of Passau, Passau, Germany
fDate :
7/1/2012 12:00:00 AM
Abstract :
Properties of scalar quantization with th power distortion and constrained Rényi entropy of order are investigated. For an asymptotically (high-rate) optimal sequence of quantizers, the contribution to the Rényi entropy due to source values in a fixed interval is identified in terms of the “entropy density” of the quantizer sequence. This extends results related to the well-known point density concept in optimal fixed-rate quantization. A dual of the entropy density result quantifies the distortion contribution of a given interval to the overall distortion. The distortion loss resulting from a mismatch of source densities in the design of an asymptotically optimal sequence of quantizers is also determined. This extends Bucklew´s fixed-rate and Gray et al.´s variable-rate mismatch results to general values of the entropy order parameter .
Keywords :
entropy; Bucklew fixed-rate; Gray variable-rate; Renyi entropy constraint; asymptotically optimal quantizer sequence; entropy density; high-rate scalar quantization mismatch; optimal fixed-rate quantization; power distortion; source densities; source densitiesentropy order parameter; Density functional theory; Entropy; Quantization; Random variables; Rate-distortion; Silicon; Vectors; Asymptotic quantization theory; Rényi entropy; distortion density; entropy density; quantizer mismatch;
Journal_Title :
Information Theory, IEEE Transactions on
DOI :
10.1109/TIT.2012.2192415