DocumentCode
935499
Title
On the convexity of higher order Jensen differences based on entropy functions (Corresp.)
Author
Burbea, Jacob ; Rao, C. Radhakrishna
Volume
28
Issue
6
fYear
1982
fDate
11/1/1982 12:00:00 AM
Firstpage
961
Lastpage
963
Abstract
In an earlier work, the authors introduced a divergence measure, called the first-order Jensen difference, or in short
-divergence, which is based on entropy functions of degree
. This provided a generalization of the measure of mutual information based on Shannon\´s entropy (corresponding to
. It was shown that the first-order
-divergence is a convex function only when a is restricted to some range. We define higher order Jensen differences and show that they are convex functions only when the underlying entropy function is of degree two. A statistical application requiring the convexity of higher order Jensen differences is indicated.
-divergence, which is based on entropy functions of degree
. This provided a generalization of the measure of mutual information based on Shannon\´s entropy (corresponding to
. It was shown that the first-order
-divergence is a convex function only when a is restricted to some range. We define higher order Jensen differences and show that they are convex functions only when the underlying entropy function is of degree two. A statistical application requiring the convexity of higher order Jensen differences is indicated.Keywords
Biological information theory; Cultural differences; Entropy; Information theory; Jacobian matrices; Mathematics; Mutual information; Statistics;
fLanguage
English
Journal_Title
Information Theory, IEEE Transactions on
Publisher
ieee
ISSN
0018-9448
Type
jour
DOI
10.1109/TIT.1982.1056573
Filename
1056573
Link To Document