Abstract :
Inequalities which connect information divergence with other measures of discrimination or distance between probability distributions are used in information theory and its applications to mathematical statistics, ergodic theory, and other scientific fields. We suggest new inequalities of this type, often based on underlying identities. As a consequence, we obtain certain improvements of the well-known Pinsker inequality. Our study depends on two measures of discrimination, called capacitory discrimination and triangular discrimination. The discussion contains references to related research and comparison with other measures of discrimination, e.g., Ali-Silvey-Csiszar (1996, 1966) divergences and, in particular, the Hellinger distance
Keywords :
information theory; probability; statistics; Ali-Silvey-Csiszar divergences; Hellinger distance; Pinsker inequality; capacitory discrimination; discrimination measures; distance measures; ergodic theory; inequalities; information divergence; information theory; mathematical statistics; scientific fields; triangular discrimination; Encoding; Frequency; Information theory; Magnetic field measurement; Notice of Violation; Probability distribution; Statistical distributions;