• DocumentCode
    1464864
  • Title

    Interval algorithm for homophonic coding

  • Author

    Hoshi, Mamoru ; Han, Te Sun

  • Author_Institution
    Graduate Sch. of Inf. Syst., Univ. of Electro-Commun., Tokyo, Japan
  • Volume
    47
  • Issue
    3
  • fYear
    2001
  • fDate
    3/1/2001 12:00:00 AM
  • Firstpage
    1021
  • Lastpage
    1031
  • Abstract
    It is shown that the idea of the successive refinement of interval partitions, which plays the key role in the interval algorithm for random number generation proposed by Han and Hoshi (see ibid., vol.43, p.599-611, 1997) is also applicable to the homophonic coding. An interval algorithm for homophonic coding is introduced which produces an independent and identically distributed (i.i.d.) sequence with probability p. Lower and upper bounds for the expected codeword length are given. Based on this, an interval algorithm for fixed-to-variable homophonic coding is established. The expected codeword length per source letter converges to H(X)/H(p) in probability as the block length tends to infinity, where H(X) is the entropy rate of the source X. The algorithm is asymptotically optimal. An algorithm for fixed-to-fixed homophonic coding is also established. The decoding error probability tends to zero as the block length tends to infinity. Homophonic coding with cost is generally considered. The expected cost of the codeword per source letter converges to c¯H(X)/H(p) in probability as the block length tends to infinity, where, c¯ denotes the average cost of a source letter. The main contribution of this paper can be regarded as a novel application of Elias´ coding technique to homophonic coding. Intrinsic relations among these algorithms, the interval algorithm for random number generation and the arithmetic code are also discussed
  • Keywords
    arithmetic codes; error statistics; random number generation; arithmetic code; asymptotically optimal algorithm; average source letter cost; block length; codeword length; decoding error probability; entropy rate; homophonic coding; i.i.d. sequence; independent identically distributed sequence; interval algorithm; lower bound; random number generation; successive refinement; upper bound; Costs; Decoding; Entropy; H infinity control; Partitioning algorithms; Random number generation; Source coding; Sun; Tellurium; Upper bound;
  • fLanguage
    English
  • Journal_Title
    Information Theory, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9448
  • Type

    jour

  • DOI
    10.1109/18.915659
  • Filename
    915659