• DocumentCode
    778617
  • Title

    A general framework for codes involving redundancy minimization

  • Author

    Baer, Michael B.

  • Author_Institution
    Dept. of Electr. Eng., Stanford Univ., CA
  • Volume
    52
  • Issue
    1
  • fYear
    2006
  • Firstpage
    344
  • Lastpage
    349
  • Abstract
    A framework with two scalar parameters is introduced for various problems of finding a prefix code minimizing a coding penalty function. The framework encompasses problems previously proposed by Huffman, Campbell, Nath, and Drmota and Szpankowski, shedding light on the relationships among these problems. In particular, Nath´s range of problems can be seen as bridging the minimum average redundancy problem of Huffman with the minimum maximum pointwise redundancy problem of Drmota and Szpankowski. Using this framework, two linear-time Huffman-like algorithms are devised for the minimum maximum pointwise redundancy problem, the only one in the framework not previously solved with a Huffman-like algorithm. Both algorithms provide solutions common to this problem and a subrange of Nath´s problems, the second algorithm being distinguished by its ability to find the minimum variance solution among all solutions common to the minimum maximum pointwise redundancy and Nath problems. Simple redundancy bounds are also presented
  • Keywords
    Huffman codes; entropy codes; minimax techniques; redundancy; Huffman-like algorithm; Renyi entropy; minimax redundancy; minimum variance solution; optimal prefix code; Algebra; Computational geometry; Convolutional codes; Galois fields; Graphical models; Mathematics; Huffman algorithm; RÉnyi entropy; minimax redundancy; optimal prefix code; unification;
  • fLanguage
    English
  • Journal_Title
    Information Theory, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9448
  • Type

    jour

  • DOI
    10.1109/TIT.2005.860469
  • Filename
    1564453