DocumentCode :
1355983
Title :
Some inequalities for information divergence and related measures of discrimination
Author :
Topsøe, Flemming
Author_Institution :
Dept. of Math., Copenhagen Univ., Denmark
Volume :
46
Issue :
4
fYear :
2000
fDate :
7/1/2000 12:00:00 AM
Firstpage :
1602
Lastpage :
1609
Abstract :
Inequalities which connect information divergence with other measures of discrimination or distance between probability distributions are used in information theory and its applications to mathematical statistics, ergodic theory, and other scientific fields. We suggest new inequalities of this type, often based on underlying identities. As a consequence, we obtain certain improvements of the well-known Pinsker inequality. Our study depends on two measures of discrimination, called capacitory discrimination and triangular discrimination. The discussion contains references to related research and comparison with other measures of discrimination, e.g., Ali-Silvey-Csiszar (1996, 1966) divergences and, in particular, the Hellinger distance
Keywords :
information theory; probability; statistics; Ali-Silvey-Csiszar divergences; Hellinger distance; Pinsker inequality; capacitory discrimination; discrimination measures; distance measures; ergodic theory; inequalities; information divergence; information theory; mathematical statistics; scientific fields; triangular discrimination; Encoding; Frequency; Information theory; Magnetic field measurement; Notice of Violation; Probability distribution; Statistical distributions;
fLanguage :
English
Journal_Title :
Information Theory, IEEE Transactions on
Publisher :
ieee
ISSN :
0018-9448
Type :
jour
DOI :
10.1109/18.850703
Filename :
850703
Link To Document :
بازگشت