• DocumentCode
    2988772
  • Title

    Concavity of entropy under thinning

  • Author

    Yu, Yaming ; Johnson, Oliver

  • Author_Institution
    Dept. of Stat., Univ. of California, Irvine, CA, USA
  • fYear
    2009
  • fDate
    June 28 2009-July 3 2009
  • Firstpage
    144
  • Lastpage
    148
  • Abstract
    Building on the recent work of Johnson (2007) and Yu (2008), we prove that entropy is a concave function with respect to the thinning operation Talpha. That is, if X and Y are independent random variables on Z+ with ultra-log-concave probability mass functions, then H(TalphaX + T1-alphaY) ges alphaH(X) + (1 - alpha)H(Y), 0 les alpha les 1, where H denotes the discrete entropy. This is a discrete analogue of the inequality (h denotes the differential entropy) h(radicalphaX + radic1 - alphaY ) ges alphah(X) + (1 - alpha)h(Y), 0 les alpha les 1, which holds for continuous X and Y with finite variances and is equivalent to Shannon´s entropy power inequality. As a consequence we establish a special case of a conjecture of Shepp and Olkin (1981). Possible extensions are also discussed.
  • Keywords
    entropy; probability; concavity; discrete entropy; thinning; ultra-log-concave probability mass functions; Bismuth; Convergence; Convolution; Entropy; Heart; Information theory; Mathematics; Random variables; Statistics; Poisson distribution; binomial thinning; convolution; entropy power inequality; ultra-log-concavity;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Information Theory, 2009. ISIT 2009. IEEE International Symposium on
  • Conference_Location
    Seoul
  • Print_ISBN
    978-1-4244-4312-3
  • Electronic_ISBN
    978-1-4244-4313-0
  • Type

    conf

  • DOI
    10.1109/ISIT.2009.5205880
  • Filename
    5205880