DocumentCode :
963713
Title :
On information theory parameters of infinite anti-uniform sources
Author :
Esmaeili, Morteza ; Kakhbod, A.
Author_Institution :
Dept. of Math. Sci., Isfahan Univ. of Technol., Isfahan
Volume :
1
Issue :
5
fYear :
2007
Firstpage :
1039
Lastpage :
1041
Abstract :
A source S= {s1, s2, ...} having a binary Huffman code with code-word lengths satisfying l1 = 1, l2 = 2, ... is called an anti-uniform source. If l1 = 1, l2 = 2, ... , li = i, then the source is called an i-level partially anti-uniform source. The redundancy, expected codeword length and entropy of anti-uniform sources are dealt here. A tight upper bound is derived for the expected codeword length L of anti-uniform sources. It is shown that L does not exceed radic(5 + 3/2). For each 1 < L les (radic(5 + 3)/2), an anti-uniform distribution achieving maximum entropy H(P)max = L log L - (L - 1)log(L - 1) is introduced. This shows that the maximum entropy achieved by anti-uniform distributions does not exceed 2.512. It is shown that the range of redundancy values for i-level partially anti-uniform sources with distribution {pi} is an interval of length Sigmaj = i + 1Pj. This results in a realistic approximation for the redundancy of these sources.
Keywords :
Huffman codes; binary codes; maximum entropy methods; source coding; statistical distributions; binary Huffman code; codeword length; infinite anti-uniform source; information theory; maximum entropy; probability distribution;
fLanguage :
English
Journal_Title :
Communications, IET
Publisher :
iet
ISSN :
1751-8628
Type :
jour
DOI :
10.1049/iet-com:20070076
Filename :
4375512
Link To Document :
بازگشت