Title :
Optimal one-bit quantization
Author :
Magnani, Alessandro ; Ghosh, Arpita ; Gray, Robert M.
Author_Institution :
Inf. Syst. Lab., Stanford Univ., CA, USA
Abstract :
We consider the problem of finding the optimal one-bit quantizer for symmetric source distributions, with the Euclidean norm as the measure of distortion. For fixed rate quantizers, we prove that for (symmetric) monotonically decreasing source distributions with ellipsoidal level curves, the centroids of the optimal 1-bit quantizer must be on the major axis of the ellipsoids. Under the same assumptions on the source distribution, the centroids of the optimal one-bit variable-rate quantizer lie on one of the axes of the ellipsoid. If further, the source distribution f(x) is log-concave in x, the optimal 1-bit fixed-rate quantizer is unique and symmetric about the origin. (The Gaussian is an example of a distribution that satisfies all these conditions.) Under a further set of conditions on the source distributions, we show that there is a threshold below which the optimal fixed rate and variable rate quantizer are the same.
Keywords :
Gaussian distribution; optimisation; rate distortion theory; source coding; variable rate codes; vector quantisation; 1-bit quantizer; Euclidean norm; Gaussian distribution; distortion measure; ellipsoidal level curves; fixed rate quantizers; log-concave distribution; monotonically decreasing source distributions; optimal one-bit quantization; symmetric source distributions; Convergence; Data compression; Distortion measurement; Ellipsoids; Entropy; Euclidean distance; Information systems; Laboratories; Lagrangian functions; Quantization;
Conference_Titel :
Data Compression Conference, 2005. Proceedings. DCC 2005
Print_ISBN :
0-7695-2309-9
DOI :
10.1109/DCC.2005.66