Title :
On the Bahadur-Efficient Testing of Uniformity by Means of the Entropy
Author :
Harremoës, Peter ; Vajda, Igor
Author_Institution :
Centrum voor Wiskunde en Inf., Amsterdam
Abstract :
This paper compares the power divergence statistics of orders with the information divergence statistic in the problem of testing the uniformity of a distribution. In this problem, the information divergence statistic is equivalent to the entropy statistic. Extending some previously established results about information diagrams, it is proved that the information divergence statistic in this problem is more efficient in the Bahadur sense than any power divergence statistic of order . This means that the entropy provides in this sense the most efficient way of characterizing the uniformity of a distribution.
Keywords :
entropy; statistical distributions; statistical testing; Bahadur-efficient uniformity distribution testing; entropy statistic; information divergence statistic; power divergence order statistics; Councils; Distribution functions; Entropy; Frequency; Information theory; Probability distribution; Statistical analysis; Statistical distributions; Statistics; Testing; Bahadur efficiency; entropy; goodness-of-fit; index of coincidence; information diagram; power divergences;
Journal_Title :
Information Theory, IEEE Transactions on
DOI :
10.1109/TIT.2007.911155