• DocumentCode
    771703
  • Title

    Asymptotics of greedy algorithms for variable-to-fixed length coding of Markov sources

  • Author

    Tabus, Ioan ; Rissanen, Jorma

  • Author_Institution
    Inst. of Signal Process., Tampere Univ. of Technol., Finland
  • Volume
    48
  • Issue
    7
  • fYear
    2002
  • fDate
    7/1/2002 12:00:00 AM
  • Firstpage
    2022
  • Lastpage
    2035
  • Abstract
    In this paper, alphabet extension for Markov sources is studied such that each extension tree is grown by splitting the node with the maximum value for a weight as a generalization of the leaf probability in Tunstall´s (1967) algorithm. We show that the optimal asymptotic rate of convergence of the per-symbol code length to the entropy does not depend on an a priori selected proportional allocation of the sizes of the extension trees at the states. We show this without imposing restrictive conditions on the weight by which the trees are extended. Further, we prove the asymptotic optimality of an algorithm that allocates an increasing total number of leaves among the states. Finally, we give exact formulas for all the relevant quantities of the trees grown
  • Keywords
    Markov processes; algorithm theory; convergence of numerical methods; data communication; optimisation; probability; trees (mathematics); variable length codes; Markov sources; Tunstall´s algorithm; asymptotic optimality; data compression; entropy; extension tree; fixed-length codeword; greedy algorithms; leaf probability; optimal asymptotic convergence rate; per-symbol code length; text compression algorithm; variable-to-fixed length coding; Convergence; Dictionaries; Encoding; Entropy; Greedy algorithms; Helium; Signal processing; Signal processing algorithms; Source coding; Stationary state;
  • fLanguage
    English
  • Journal_Title
    Information Theory, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9448
  • Type

    jour

  • DOI
    10.1109/TIT.2002.1013141
  • Filename
    1013141