Title :
Fixed-rate universal lossy source coding and rates of convergence for memoryless sources
Author :
Linder, Tamás ; Lugosi, Gábor ; Zeger, Kenneth
Author_Institution :
Dept. of Telecommun., Tech. Univ. Budapest, Hungary
fDate :
5/1/1995 12:00:00 AM
Abstract :
A fixed-rate universal lossy coding scheme is introduced for independent and identically distributed (i.i.d.) sources. It is shown for finite alphabet sources and arbitrary single letter distortion measures that as the sample size n grows the expected distortion obtained using this universal scheme converges to Shannon´s distortion rate function D(R) at a rate O(log n/n). The scheme can be extended to universal quantization of real i.i.d sources subject to a squared error criterion. It is shown in this case that the per-letter distortion converges to D(R) at a rate O(√(log n/n)) both in expectation and almost surely for any real-valued bounded i.i.d. source
Keywords :
convergence of numerical methods; memoryless systems; quantisation (signal); rate distortion theory; source coding; Shannon´s distortion rate function; convergence rates; distortion; finite alphabet sources; independent identically distributed sources; memoryless sources; sample size; single letter distortion measures; squared error criterion; universal lossy source coding; universal quantization; Convergence; Distortion measurement; Loss measurement; Minimax techniques; Performance loss; Quantization; Rate distortion theory; Size measurement; Source coding; Sufficient conditions;
Journal_Title :
Information Theory, IEEE Transactions on