DocumentCode :
930849
Title :
Axiomatic characterization of the directed divergences and their linear combinations
Author :
Johnson, Rodney W.
Volume :
25
Issue :
6
fYear :
1979
fDate :
11/1/1979 12:00:00 AM
Firstpage :
709
Lastpage :
716
Abstract :
The directed divergences of two probability densities p and q are given by \\int p(x) \\log (p(x)/q(x))dx and by the same expression with p and q interchanged; the divergence is the sum of the directed divergences. These quantities have applications in information theory and to the problem of assigning prior probabilities subject to constraints. It is shown that the directed divergences and their positive linear combinations, including the divegeoce, are characterized by axioms of it{positivity, additivity}, and it{finiteness}, which are fundamental in work on prior probabilities. In the course of the proof, the latter two are shown to imply yet another axiom: it{linear invariance}.
Keywords :
Probability functions; Books; Coordinate measuring machines; Density measurement; Entropy; Extraterrestrial measurements; Particle measurements; Probability density function; Q measurement; Terminology;
fLanguage :
English
Journal_Title :
Information Theory, IEEE Transactions on
Publisher :
ieee
ISSN :
0018-9448
Type :
jour
DOI :
10.1109/TIT.1979.1056113
Filename :
1056113
Link To Document :
بازگشت