Title :
High-Resolution Scalar Quantization With Rényi Entropy Constraint
Author :
Kreitmeier, Wolfgang ; Linder, Tamás
Author_Institution :
Dept. of Inf. & Math., Univ. of Passau, Passau, Germany
Abstract :
We consider optimal scalar quantization with rth power distortion and constrained Rényi entropy of order α. For sources with absolutely continuous distributions the high rate asymptotics of the quantizer distortion has long been known for α = 0 (fixed-rate quantization) and α = 1 (entropy-constrained quantization). These results have recently been extended to quantization with Rényi entropy constraint of order α ≥ r+1. Here we consider the more challenging case α ∈ [-∞,0)∪(0,1) and for a large class of absolutely continuous source distributions we determine the sharp asymptotics of the optimal quantization distortion. The achievability proof is based on finding (asymptotically) optimal quantizers via the companding approach, and is thus constructive.
Keywords :
entropy; quantisation (quantum theory); absolute continuous source distributions; high-resolution scalar quantization; power distortion; rényi entropy constraint; Approximation methods; Density measurement; Entropy; Quantization; Random variables; Upper bound; Companding; Rényi entropy; high-resolution asymptotics; optimal quantization;
Journal_Title :
Information Theory, IEEE Transactions on
DOI :
10.1109/TIT.2011.2165809