• DocumentCode
    1459157
  • Title

    Some Upper Bounds on the Redundancy of Optimal Binary Fix-Free Codes

  • Author

    Khosravifard, Mohammadali ; Kheradmand, Shima

  • Author_Institution
    Dept. of Electr. & Comput. Eng., Isfahan Univ. of Technol., Isfahan, Iran
  • Volume
    58
  • Issue
    6
  • fYear
    2012
  • fDate
    6/1/2012 12:00:00 AM
  • Firstpage
    4049
  • Lastpage
    4057
  • Abstract
    In order to investigate the cost of employing fix-free codes instead of the well-established prefix-free codes, some upper bounds on the redundancy of the optimal fix-free codes and their difference with the corresponding Huffman codes are presented. Unlike the conventional approach, which is based on some Shannon-like suboptimal codes, we examine the redundancy of a better Huffman-like code. An algorithm is proposed for deriving optimal binary codeword lengths with Kraft-sum [5/8] for a given probability distribution. The existence of a fix-free code with such codelengths is guaranteed by Yekhanin´s theorem. It is shown that the redundancy of this fix-free code is, at most, 0.8 bit greater than that of the Huffman code and does not exceed [8/3]-log3 ≅ 1.0817 bits. This upper bound is [4/3]-log[5/3] ≅0.5964 bit less than the best known one. If the [3/4]-conjecture is proved sometime in the future, the presented upper bound on the redundancy of the optimal fix-free codes (i.e., 1.0817) will be improved by only [5/3]-log3 ≅ 0.0817 . In addition to these general bounds, all known upper bounds in terms of the largest, the smallest, and an arbitrary given symbol probability are substantially improved.
  • Keywords
    Huffman codes; binary codes; redundancy; statistical distributions; Huffman codes; Kraft-sum; Shannon-like suboptimal codes; Yekhanin theorem; binary codeword lengths; optimal binary fix-free codes redundancy; prefix-free codes; probability distribution; symbol probability; Context; Decoding; Probability distribution; Radio frequency; Redundancy; Upper bound; Vectors; ${{3}over{4}}$-Conjecture; Kraft-sum; Yekhanin\´s theorem; optimal fix-free code; redundancy;
  • fLanguage
    English
  • Journal_Title
    Information Theory, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9448
  • Type

    jour

  • DOI
    10.1109/TIT.2012.2189433
  • Filename
    6159084