• DocumentCode
    3518364
  • Title

    The entropy of a code with probabilities

  • Author

    Da Rocha, Valdemar C., Jr. ; De Oliveira, Hélio M.

  • Author_Institution
    Dept. of Electron. & Syst., Univ. Fed. de Pernambuco, Recife, Brazil
  • Volume
    2
  • fYear
    1998
  • fDate
    9-13 Aug 1998
  • Firstpage
    521
  • Abstract
    The entropy of a code with probabilities is defined and as a consequence the concept of conservation of entropy in lossless source coding emerges in a natural manner. For any given probability distribution (p1,p2,...,pT) all the distinct decompositions of the associated entropy function h(p1 ,p2,...,pT), as a function of entropies of lower order, are obtained from the terminal uncertainty of the distinct rooted trees with leaf probabilities (p1,p2,...,p T)
  • Keywords
    entropy codes; probability; source coding; trees (mathematics); code entropy; conservation of entropy; decompositions; distinct rooted trees; leaf probabilities; lossless coding; probability distribution; source coding; terminal uncertainty; Codecs; Decoding; Encoding; Entropy; Leg; Probability distribution; Random variables; Source coding; Sufficient conditions; Uncertainty;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Telecommunications Symposium, 1998. ITS '98 Proceedings. SBT/IEEE International
  • Conference_Location
    Sao Paulo
  • Print_ISBN
    0-7803-5030-8
  • Type

    conf

  • DOI
    10.1109/ITS.1998.718448
  • Filename
    718448