DocumentCode
773003
Title
Fixed-rate universal lossy source coding and rates of convergence for memoryless sources
Author
Linder, Tamás ; Lugosi, Gábor ; Zeger, Kenneth
Author_Institution
Dept. of Telecommun., Tech. Univ. Budapest, Hungary
Volume
41
Issue
3
fYear
1995
fDate
5/1/1995 12:00:00 AM
Firstpage
665
Lastpage
676
Abstract
A fixed-rate universal lossy coding scheme is introduced for independent and identically distributed (i.i.d.) sources. It is shown for finite alphabet sources and arbitrary single letter distortion measures that as the sample size n grows the expected distortion obtained using this universal scheme converges to Shannon´s distortion rate function D(R) at a rate O(log n/n). The scheme can be extended to universal quantization of real i.i.d sources subject to a squared error criterion. It is shown in this case that the per-letter distortion converges to D(R) at a rate O(√(log n/n)) both in expectation and almost surely for any real-valued bounded i.i.d. source
Keywords
convergence of numerical methods; memoryless systems; quantisation (signal); rate distortion theory; source coding; Shannon´s distortion rate function; convergence rates; distortion; finite alphabet sources; independent identically distributed sources; memoryless sources; sample size; single letter distortion measures; squared error criterion; universal lossy source coding; universal quantization; Convergence; Distortion measurement; Loss measurement; Minimax techniques; Performance loss; Quantization; Rate distortion theory; Size measurement; Source coding; Sufficient conditions;
fLanguage
English
Journal_Title
Information Theory, IEEE Transactions on
Publisher
ieee
ISSN
0018-9448
Type
jour
DOI
10.1109/18.382013
Filename
382013
Link To Document