Title :
The entropy of a code with probabilities
Author :
Da Rocha, Valdemar C., Jr. ; De Oliveira, Hélio M.
Author_Institution :
Dept. of Electron. & Syst., Univ. Fed. de Pernambuco, Recife, Brazil
Abstract :
The entropy of a code with probabilities is defined and as a consequence the concept of conservation of entropy in lossless source coding emerges in a natural manner. For any given probability distribution (p1,p2,...,pT) all the distinct decompositions of the associated entropy function h(p1 ,p2,...,pT), as a function of entropies of lower order, are obtained from the terminal uncertainty of the distinct rooted trees with leaf probabilities (p1,p2,...,p T)
Keywords :
entropy codes; probability; source coding; trees (mathematics); code entropy; conservation of entropy; decompositions; distinct rooted trees; leaf probabilities; lossless coding; probability distribution; source coding; terminal uncertainty; Codecs; Decoding; Encoding; Entropy; Leg; Probability distribution; Random variables; Source coding; Sufficient conditions; Uncertainty;
Conference_Titel :
Telecommunications Symposium, 1998. ITS '98 Proceedings. SBT/IEEE International
Conference_Location :
Sao Paulo
Print_ISBN :
0-7803-5030-8
DOI :
10.1109/ITS.1998.718448
