Title :
An information-spectrum approach to source coding theorems with a fidelity criterion
Author_Institution :
Graduate Sch. of Inf. Syst., Univ. of Electro-Commun., Tokyo, Japan
fDate :
7/1/1997 12:00:00 AM
Abstract :
The rate-distortion problem for the general class of nonstationary and/or nonergodic sources with an arbitrary distortion measure (not necessarily additive) is studied. We are especially concerned with the case of variable-rate coding under maximum-distortion criterion. It turns out that, in the framework where we cannot readily invoke the standard asymptotic equipartition property, an information-spectrum approach devised by Han and Verdu (1993) plays the key role in establishing such a general formula. Comparisons with the rate-distortion formulas with fixed-rate coding of Steinberg and Verdu (see ibid., vol.42, no.1, p.63-86, 1996) are also discussed to obtain an insight into the general features of this kind of nonstationary and nonergodic problems
Keywords :
rate distortion theory; source coding; spectral analysis; variable rate codes; asymptotic equipartition property; distortion measure; fidelity criterion; fixed rate coding; information spectrum; maximum distortion criterion; nonergodic problems; nonergodic sources; nonstationary problems; nonstationary sources; rate distortion formulas; rate distortion problem; source coding theorems; variable rate coding; Additives; Codes; Distortion measurement; Helium; Information systems; Measurement standards; Rate-distortion; Source coding; Sun; Tellurium;
Journal_Title :
Information Theory, IEEE Transactions on