• DocumentCode
    1072395
  • Title

    On zero-error source coding with decoder side information

  • Author

    Koulgi, Prashant ; Tuncel, Ertem ; Regunathan, Shankar L. ; Rose, Kenneth

  • Author_Institution
    Dept. of Electr. & Comput. Eng., Univ. of California, Santa Barbara, CA, USA
  • Volume
    49
  • Issue
    1
  • fYear
    2003
  • fDate
    1/1/2003 12:00:00 AM
  • Firstpage
    99
  • Lastpage
    111
  • Abstract
    Let (X,Y) be a pair of random variables distributed over a finite product set V×W according to a probability distribution P(x,y). The following source coding problem is considered: the encoder knows X, while the decoder knows Y and wants to learn X without error. The minimum zero-error asymptotic rate of transmission is shown to be the complementary graph entropy of an associated graph. Thus, previous results in the literature provide upper and lower bounds for this minimum rate (further, these bounds are tight for the important class of perfect graphs). The algorithmic aspects of instantaneous code design are considered next. It is shown that optimal code design is NP-hard. An optimal code design algorithm is derived. Polynomial-time suboptimal algorithms are also presented, and their average and worst case performance guarantees are established.
  • Keywords
    computational complexity; decoding; entropy; random processes; source coding; NP-hard problem; average performance guarantee; complementary graph entropy; decoder; decoder side information; finite product set; instantaneous code design; lower bounds; minimum zero-error asymptotic transmission rate; optimal code design algorithm; polynomial-time suboptimal algorithms; probability distribution; random variables; upper bounds; worst case performance guarantee; zero-error source coding; Algorithm design and analysis; Decoding; Entropy; Helium; Information theory; Materials science and technology; Polynomials; Probability distribution; Random variables; Source coding;
  • fLanguage
    English
  • Journal_Title
    Information Theory, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9448
  • Type

    jour

  • DOI
    10.1109/TIT.2002.806154
  • Filename
    1159765