• DocumentCode
    773003
  • Title

    Fixed-rate universal lossy source coding and rates of convergence for memoryless sources

  • Author

    Linder, Tamás ; Lugosi, Gábor ; Zeger, Kenneth

  • Author_Institution
    Dept. of Telecommun., Tech. Univ. Budapest, Hungary
  • Volume
    41
  • Issue
    3
  • fYear
    1995
  • fDate
    5/1/1995 12:00:00 AM
  • Firstpage
    665
  • Lastpage
    676
  • Abstract
    A fixed-rate universal lossy coding scheme is introduced for independent and identically distributed (i.i.d.) sources. It is shown for finite alphabet sources and arbitrary single letter distortion measures that as the sample size n grows the expected distortion obtained using this universal scheme converges to Shannon´s distortion rate function D(R) at a rate O(log n/n). The scheme can be extended to universal quantization of real i.i.d sources subject to a squared error criterion. It is shown in this case that the per-letter distortion converges to D(R) at a rate O(√(log n/n)) both in expectation and almost surely for any real-valued bounded i.i.d. source
  • Keywords
    convergence of numerical methods; memoryless systems; quantisation (signal); rate distortion theory; source coding; Shannon´s distortion rate function; convergence rates; distortion; finite alphabet sources; independent identically distributed sources; memoryless sources; sample size; single letter distortion measures; squared error criterion; universal lossy source coding; universal quantization; Convergence; Distortion measurement; Loss measurement; Minimax techniques; Performance loss; Quantization; Rate distortion theory; Size measurement; Source coding; Sufficient conditions;
  • fLanguage
    English
  • Journal_Title
    Information Theory, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9448
  • Type

    jour

  • DOI
    10.1109/18.382013
  • Filename
    382013