DocumentCode :
2273506
Title :
Concentration and relative entropy for compound Poisson distributions
Author :
Madiman, M. ; Kontoyiannis, I.
Author_Institution :
Div. of Appl. Math., Brown Univ., Providence, RI
fYear :
2005
fDate :
4-9 Sept. 2005
Firstpage :
1833
Lastpage :
1837
Abstract :
Using a simple inequality about the relative entropy, its so-called "tensorization property," we give a simple proof of a functional inequality which is satisfied by any compound Poisson distribution. This functional inequality belongs to the class of modified logarithmic Sobolev inequalities. We use it to obtain measure concentration bounds for compound Poisson distributions under a variety of assumptions on their tail behavior. In particular, we show how the celebrated "Herbst argument" can be modified to yield sub-exponential concentration bounds. For example, suppose Z is a compound Poisson random variable with values on the nonnegative integers, and let f be a function such that |f(k+1) - f(k)| les 1 for all k. Then, if the base distribution of Z does not have a finite moment-generating function but has finite moments up to some order L > 1, we show that the probability that f(Z) exceeds its mean by a positive amount t or more decays approximately like (const)middott-L, where the constant is explicitly identified. This appears to be one of the very first examples of concentration bounds with power-law decay
Keywords :
Poisson distribution; entropy; Herbst argument; Sobolev inequalities; compound Poisson distribution; compound Poisson distributions; functional inequality; power-law decay; relative entropy; sub-exponential concentration bounds; tensorization property; Algorithm design and analysis; Computer science; Entropy; Functional analysis; Information geometry; Mathematics; Physics; Probability distribution; Random variables; Statistical analysis;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Information Theory, 2005. ISIT 2005. Proceedings. International Symposium on
Conference_Location :
Adelaide, SA
Print_ISBN :
0-7803-9151-9
Type :
conf
DOI :
10.1109/ISIT.2005.1523662
Filename :
1523662
Link To Document :
بازگشت