Title :
Successive refinement of information
Author :
Equitz, William H R ; Cover, Thomas M.
Author_Institution :
IBM Almaden Res. Center, San Jose, CA, USA
fDate :
3/1/1991 12:00:00 AM
Abstract :
The successive refinement of information consists of first approximating data using a few bits of information, then iteratively improving the approximation as more and more information is supplied. The goal is to achieve an optimal description at each stage. In general, an ongoing description which is rate-distortion optimal whenever it is interrupted is sought. It is shown that in order to achieve optimal successive refinement the necessary and sufficient conditions are that the solutions of the rate distortion problem can be written as a Markov chain. In particular, all finite alphabet signals with Hamming distortion satisfy these requirements. It is also shown that the same is true for Gaussian signals with squared error distortion and for Laplacian signals with absolute error distortion. A simple counterexample with absolute error distortion and a symmetric source distribution which shows that successive refinement is not always achievable is presented
Keywords :
information theory; Gaussian signals; Hamming distortion; Laplacian signals; absolute error distortion; finite alphabet signals; information theory; optimal description; rate distortion problem; squared error distortion; successive refinement; symmetric source distribution; Distortion; Gaussian distribution; Image coding; Information theory; Laplace equations; Propagation losses; Random variables; Rate-distortion; Statistics; Tree data structures;
Journal_Title :
Information Theory, IEEE Transactions on