Title :
Thinning and information projections
Author :
Harremoes, Peter ; Johnson, Oliver ; Kontoyiannis, Ioannis
Author_Institution :
Stat. learning & quant. comp., Centrum voor Wiskunde en Inf., Amsterdam
Abstract :
The law of thin numbers is a Poisson approximation theorem related to the thinning operation. We use information projections to derive lower bounds on the information divergence from a thinned distribution to a Poisson distribution. Conditions for the existence of projections are given. If an information projection exists it must be an element of the associated exponential family. Exponential families are used to derive lower bounds on information divergence and lower bounds on the rate of convergence in the law of thin numbers. A method of translating results related to Poisson distributions into results related to Gaussian distributions is developed and used to prove a new non-trivial result related to the central limit theorem.
Keywords :
approximation theory; information theory; stochastic processes; Gaussian distributions; Poisson approximation theorem; central limit theorem; information divergence; information projections; Convergence; Gaussian distribution;
Conference_Titel :
Information Theory, 2008. ISIT 2008. IEEE International Symposium on
Conference_Location :
Toronto, ON
Print_ISBN :
978-1-4244-2256-2
Electronic_ISBN :
978-1-4244-2257-9
DOI :
10.1109/ISIT.2008.4595471