DocumentCode :
3505772
Title :
Further results on geometric properties of a family of relative entropies
Author :
Moses, Ashok Kumar ; Sundaresan, Rajesh
Author_Institution :
Dept. of ECE, Indian Inst. of Sci., Bangalore, India
fYear :
2011
fDate :
July 31 2011-Aug. 5 2011
Firstpage :
1940
Lastpage :
1944
Abstract :
This paper extends some geometric properties of a one-parameter family of relative entropies. These arise as redundancies when cumulants of compressed lengths are considered instead of expected compressed lengths. These parametric relative entropies are a generalization of the Kullback-Leibler divergence. They satisfy the Pythagorean property and behave like squared distances. This property, which was known for finite alphabet spaces, is now extended for general measure spaces. Existence of projections onto convex and certain closed sets is also established. Our results may have applications in the Rényi entropy maximization rule of statistical physics.
Keywords :
entropy; 2011; Kullback-Leibler divergence; Pythagorean property; Renyi entropy maximization rule; entropy geometric property; finite alphabet space property; one-parameter relative entropy family; squared distance property; statistical physics; Atmospheric measurements; Entropy; Extraterrestrial measurements; Particle measurements; Q measurement; Redundancy;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Information Theory Proceedings (ISIT), 2011 IEEE International Symposium on
Conference_Location :
St. Petersburg
ISSN :
2157-8095
Print_ISBN :
978-1-4577-0596-0
Electronic_ISBN :
2157-8095
Type :
conf
DOI :
10.1109/ISIT.2011.6033890
Filename :
6033890
Link To Document :
بازگشت