Title :
Vector quantizers with direct sum codebooks
Author :
Barnes, Christopher F. ; Frost, Richard L.
Author_Institution :
Georgia Tech. Res. Inst., Georgia Inst. of Technol., Atlanta, GA, USA
fDate :
3/1/1993 12:00:00 AM
Abstract :
The use of direct sum codebooks to minimize the memory requirements of vector quantizers is investigated. Assuming arbitrary fixed partitions, necessary conditions for minimum distortion codebooks are derived, first for scalar codebooks, assuming mean-squared error distortion, and then for vector codebooks and a broader class of distortion measures. An iterative procedure is described for designing locally optimal direct sum codebooks. Both optimal and computationally efficient suboptimal encoding schemes are considered. It is shown that although an optimal encoding can be implemented by a sequential encoder, the complexity of implementing optimal stagewise partitions generally exceeds the complexity of an exhaustive search of the direct sum codebook. It is also shown that sequential nearest-neighbor encoders can be extremely inefficient. The M-search method is explored as one method of improving the effectiveness of suboptimal sequential encoders. Representative results for simulated direct sum quantizers are presented
Keywords :
encoding; iterative methods; optimisation; search problems; vector quantisation; M-search method; arbitrary fixed partitions; complexity; direct sum codebooks; iterative procedure; mean-squared error distortion; minimum distortion codebooks; nearest-neighbor encoders; necessary conditions; optimal encoding; optimal stagewise partitions; scalar codebooks; sequential encoder; suboptimal encoding schemes; vector codebooks; vector quantizers; Books; Convergence; Costs; Distortion measurement; Encoding; Gaussian processes; Information theory; Laplace equations; Source coding; Vector quantization;
Journal_Title :
Information Theory, IEEE Transactions on