Title :
Entropy Testing is Efficient
Author :
Harremoes, P. ; Vajda, I.
Author_Institution :
Centrum voor Wiskunde en Inf., Amsterdam
Abstract :
This paper compares the power divergence statistics of orders alpha > 1 with the information divergence statistic in the problem of testing the uniformity of a distribution. In this problem the information divergence statistic is equivalent to the entropy statistic. Extending some previously established results about information diagrams, it is proved that in this problem the information divergence statistic is more efficient in the Bahadur sense than any power divergence statistic of order alpha > 1. This means that the entropy provides in a certain sense the most efficient way of characterizing the uniformity of a distribution.
Keywords :
entropy; statistical analysis; Bahadur sense; entropy testing; information diagrams; information divergence statistic; power divergence statistics; Automation; Entropy; Frequency; Power measurement; Probability distribution; Q measurement; Statistical analysis; Statistical distributions; Statistics; Testing;
Conference_Titel :
Information Theory, 2007. ISIT 2007. IEEE International Symposium on
Conference_Location :
Nice
Print_ISBN :
978-1-4244-1397-3
DOI :
10.1109/ISIT.2007.4557489