• DocumentCode
    3663228
  • Title

    On a partition of a finite set and its relationships to encoding tasks and the Rényi entropy

  • Author

    Hiroki Koga

  • Author_Institution
    Faculty of Engineering, Systems and Information, University of Tsukuba, 1-1-1 Tennoudai, Tsukuba-shi, Ibaraki 305-8573, Japan
  • fYear
    2015
  • fDate
    6/1/2015 12:00:00 AM
  • Firstpage
    1452
  • Lastpage
    1456
  • Abstract
    In the problem of encoding tasks introduced by Bunte and Lapidoth, a finite alphabet χ is partitioned to M disjoint subsets {ℒm}mM=1 called lists. In this paper we consider the partition of χ into M lists satisfying L(x) ≤ λ(x) for all x ∈ χ for an arbitrarily given mapping λ: χ → [1, ∞), where L(x) denotes the cardinality of the list ℒm satisfying x ∈ ℒm. We investigate the minimum number M*(λ) of the lists meeting this constraint and give a lower and an upper bounds on M*(λ) described in terms of λ. We also show that the partition algorithm given by Bunte and Lapidoth attains M*(λ) with a slight modification. Relationships between M*(λ) and the Rényi entropy are also discussed.
  • Keywords
    "Entropy","Upper bound","Probability distribution","Channel coding","Partitioning algorithms","Random variables"
  • Publisher
    ieee
  • Conference_Titel
    Information Theory (ISIT), 2015 IEEE International Symposium on
  • Electronic_ISBN
    2157-8117
  • Type

    conf

  • DOI
    10.1109/ISIT.2015.7282696
  • Filename
    7282696