DocumentCode
2988772
Title
Concavity of entropy under thinning
Author
Yu, Yaming ; Johnson, Oliver
Author_Institution
Dept. of Stat., Univ. of California, Irvine, CA, USA
fYear
2009
fDate
June 28 2009-July 3 2009
Firstpage
144
Lastpage
148
Abstract
Building on the recent work of Johnson (2007) and Yu (2008), we prove that entropy is a concave function with respect to the thinning operation Talpha. That is, if X and Y are independent random variables on Z+ with ultra-log-concave probability mass functions, then H(TalphaX + T1-alphaY) ges alphaH(X) + (1 - alpha)H(Y), 0 les alpha les 1, where H denotes the discrete entropy. This is a discrete analogue of the inequality (h denotes the differential entropy) h(radicalphaX + radic1 - alphaY ) ges alphah(X) + (1 - alpha)h(Y), 0 les alpha les 1, which holds for continuous X and Y with finite variances and is equivalent to Shannon´s entropy power inequality. As a consequence we establish a special case of a conjecture of Shepp and Olkin (1981). Possible extensions are also discussed.
Keywords
entropy; probability; concavity; discrete entropy; thinning; ultra-log-concave probability mass functions; Bismuth; Convergence; Convolution; Entropy; Heart; Information theory; Mathematics; Random variables; Statistics; Poisson distribution; binomial thinning; convolution; entropy power inequality; ultra-log-concavity;
fLanguage
English
Publisher
ieee
Conference_Titel
Information Theory, 2009. ISIT 2009. IEEE International Symposium on
Conference_Location
Seoul
Print_ISBN
978-1-4244-4312-3
Electronic_ISBN
978-1-4244-4313-0
Type
conf
DOI
10.1109/ISIT.2009.5205880
Filename
5205880
Link To Document