DocumentCode :
2522077
Title :
Thinning and information projections
Author :
Harremoes, Peter ; Johnson, Oliver ; Kontoyiannis, Ioannis
Author_Institution :
Stat. learning & quant. comp., Centrum voor Wiskunde en Inf., Amsterdam
fYear :
2008
fDate :
6-11 July 2008
Firstpage :
2644
Lastpage :
2648
Abstract :
The law of thin numbers is a Poisson approximation theorem related to the thinning operation. We use information projections to derive lower bounds on the information divergence from a thinned distribution to a Poisson distribution. Conditions for the existence of projections are given. If an information projection exists it must be an element of the associated exponential family. Exponential families are used to derive lower bounds on information divergence and lower bounds on the rate of convergence in the law of thin numbers. A method of translating results related to Poisson distributions into results related to Gaussian distributions is developed and used to prove a new non-trivial result related to the central limit theorem.
Keywords :
approximation theory; information theory; stochastic processes; Gaussian distributions; Poisson approximation theorem; central limit theorem; information divergence; information projections; Convergence; Gaussian distribution;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Information Theory, 2008. ISIT 2008. IEEE International Symposium on
Conference_Location :
Toronto, ON
Print_ISBN :
978-1-4244-2256-2
Electronic_ISBN :
978-1-4244-2257-9
Type :
conf
DOI :
10.1109/ISIT.2008.4595471
Filename :
4595471
Link To Document :
بازگشت