• DocumentCode
    2269083
  • Title

    On the redundancy of lossy source coding

  • Author

    Zhang, Zhen ; Yang, En-Hui ; Wei, Victor K.

  • Author_Institution
    Dept. of Electr. Eng. Syst., Univ. of Southern California, Los Angeles, CA, USA
  • fYear
    1995
  • fDate
    17-22 Sep 1995
  • Firstpage
    190
  • Abstract
    The redundancy of a source code is the difference between its expected performance and the optimum performance theoretically attainable (OPTA). In an analysis of the redundancy problem of source coding the aim is to investigate the trade-off between the minimum redundancy over a class of codes having a common parameter (such as block length) and the common parameter. We assume that the common parameter associated with the codes considered is block length. We refer to the minimum redundancy over the class of all codes having block length n and some specified type as the nth-order redundancy. In lossless source coding, the OPTA is the Shannon entropy and there exists extensive literature studying the nth-order redundancy. Before our work, nontrivial lower bounds are still unknown to either the n-th order rate redundancy or the n-th order distortion redundancy. The aim of this paper is to answer the question of whether Pilc´s (1968) lower bound is true. We derive a closed formula for the nth-order distortion redundancy and prove the formula for the upper and lower bounds of the nth-order rate redundancy
  • Keywords
    entropy; rate distortion theory; redundancy; source coding; Pilc´s lower bound; Shannon entropy; block length; closed formula; common parameter; distortion redundancy; lossless source coding; lossy source coding; minimum redundancy; nontrivial lower bounds; optimum performance theoretically attainable; rate redundancy; redundancy; redundancy problem; source code; upper bound; Block codes; Entropy; Production; Rate distortion theory; Rate-distortion; Source coding; Statistics;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Information Theory, 1995. Proceedings., 1995 IEEE International Symposium on
  • Conference_Location
    Whistler, BC
  • Print_ISBN
    0-7803-2453-6
  • Type

    conf

  • DOI
    10.1109/ISIT.1995.531539
  • Filename
    531539