Title :
On the Maximum Entropy Properties of the Binomial Distribution
Author_Institution :
Dept. of Stat., Univ. of California, Irvine, CA
fDate :
7/1/2008 12:00:00 AM
Abstract :
It is shown that the Binomial(n,p) distribution maximizes the entropy in the class of ultra-log-concave distributions of order n with fixed mean np. This result, which extends a theorem of Shepp and Olkin (1981), is analogous to that of Johnson (2007), who considers the Poisson case. The proof constructs a Markov chain whose limiting distribution is Binomial(n,p) and shows that the entropy never decreases along the iterations of this Markov chain.
Keywords :
Markov processes; Poisson distribution; binomial distribution; maximum entropy methods; Markov chain; Poisson case; binomial distribution; maximum entropy properties; ultra log concave distributions; Bernoulli sum; Markov chain; hypergeometric thinning; ultra-log-concavity;
Journal_Title :
Information Theory, IEEE Transactions on
DOI :
10.1109/TIT.2008.924715