Title :
On a partition of a finite set and its relationships to encoding tasks and the Rényi entropy
Author_Institution :
Faculty of Engineering, Systems and Information, University of Tsukuba, 1-1-1 Tennoudai, Tsukuba-shi, Ibaraki 305-8573, Japan
fDate :
6/1/2015 12:00:00 AM
Abstract :
In the problem of encoding tasks introduced by Bunte and Lapidoth, a finite alphabet χ is partitioned to M disjoint subsets {ℒm}mM=1 called lists. In this paper we consider the partition of χ into M lists satisfying L(x) ≤ λ(x) for all x ∈ χ for an arbitrarily given mapping λ: χ → [1, ∞), where L(x) denotes the cardinality of the list ℒm satisfying x ∈ ℒm. We investigate the minimum number M*(λ) of the lists meeting this constraint and give a lower and an upper bounds on M*(λ) described in terms of λ. We also show that the partition algorithm given by Bunte and Lapidoth attains M*(λ) with a slight modification. Relationships between M*(λ) and the Rényi entropy are also discussed.
Keywords :
"Entropy","Upper bound","Probability distribution","Channel coding","Partitioning algorithms","Random variables"
Conference_Titel :
Information Theory (ISIT), 2015 IEEE International Symposium on
Electronic_ISBN :
2157-8117
DOI :
10.1109/ISIT.2015.7282696