DocumentCode :
3118100
Title :
Shannon entropy convergence results in the countable infinite case
Author :
Silva, Jorge F. ; Parada, Patricio A.
Author_Institution :
Dept. of Electr. Eng., Univ. of Chile, Santiago, Chile
fYear :
2012
fDate :
1-6 July 2012
Firstpage :
155
Lastpage :
159
Abstract :
The convergence of the Shannon entropy in the countable infinity case is revisited and extended in this work. New results are presented that provide necessary and sufficient conditions for the convergence of the entropy in different settings, including scenarios with both finitely and infinitely supported measures. These results show some connections between the Shannon entropy convergence and the convergence in information divergence.
Keywords :
entropy; Shannon entropy convergence; countable infinite case; information divergence; Context; Convergence; Entropy; Estimation; Information theory; Limiting; Topology;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Information Theory Proceedings (ISIT), 2012 IEEE International Symposium on
Conference_Location :
Cambridge, MA
ISSN :
2157-8095
Print_ISBN :
978-1-4673-2580-6
Electronic_ISBN :
2157-8095
Type :
conf
DOI :
10.1109/ISIT.2012.6283535
Filename :
6283535
Link To Document :
بازگشت