• DocumentCode
    963713
  • Title

    On information theory parameters of infinite anti-uniform sources

  • Author

    Esmaeili, Morteza ; Kakhbod, A.

  • Author_Institution
    Dept. of Math. Sci., Isfahan Univ. of Technol., Isfahan
  • Volume
    1
  • Issue
    5
  • fYear
    2007
  • Firstpage
    1039
  • Lastpage
    1041
  • Abstract
    A source S= {s1, s2, ...} having a binary Huffman code with code-word lengths satisfying l1 = 1, l2 = 2, ... is called an anti-uniform source. If l1 = 1, l2 = 2, ... , li = i, then the source is called an i-level partially anti-uniform source. The redundancy, expected codeword length and entropy of anti-uniform sources are dealt here. A tight upper bound is derived for the expected codeword length L of anti-uniform sources. It is shown that L does not exceed radic(5 + 3/2). For each 1 < L les (radic(5 + 3)/2), an anti-uniform distribution achieving maximum entropy H(P)max = L log L - (L - 1)log(L - 1) is introduced. This shows that the maximum entropy achieved by anti-uniform distributions does not exceed 2.512. It is shown that the range of redundancy values for i-level partially anti-uniform sources with distribution {pi} is an interval of length Sigmaj = i + 1Pj. This results in a realistic approximation for the redundancy of these sources.
  • Keywords
    Huffman codes; binary codes; maximum entropy methods; source coding; statistical distributions; binary Huffman code; codeword length; infinite anti-uniform source; information theory; maximum entropy; probability distribution;
  • fLanguage
    English
  • Journal_Title
    Communications, IET
  • Publisher
    iet
  • ISSN
    1751-8628
  • Type

    jour

  • DOI
    10.1049/iet-com:20070076
  • Filename
    4375512