Title :
On asymptotic properties of information-theoretic divergences
Author :
Pardo, María Del Carmen ; Vajda, Igor
Author_Institution :
Dept. of Stat. & O. R., Complutense Univ. of Madrid, Spain
fDate :
7/1/2003 12:00:00 AM
Abstract :
Mutual asymptotic equivalence is established within three classes of information-theoretic divergences of discrete probability distributions, namely, f-divergences of Csiszar, f-divergences of Bregman, and f-divergences of Burbea-Rao. These equivalences are used to find asymptotic distributions of the corresponding divergence statistics for testing the goodness of fit when the hypothetic distribution is uniform. All results are based on standard expansion techniques and on a new relation between the Bregman and Burbea-Rao divergences formulated in Lemma 2 of the paper.
Keywords :
information theory; probability; Bregman f-divergences; Burbea-Rao f-divergences; Csiszdr f-divergences; asymptotic properties; discrete probability distributions; information-theoretic divergences; mutual asymptotic equivalence; Bayesian methods; Probability;
Journal_Title :
Information Theory, IEEE Transactions on
DOI :
10.1109/TIT.2003.813509