DocumentCode
3118100
Title
Shannon entropy convergence results in the countable infinite case
Author
Silva, Jorge F. ; Parada, Patricio A.
Author_Institution
Dept. of Electr. Eng., Univ. of Chile, Santiago, Chile
fYear
2012
fDate
1-6 July 2012
Firstpage
155
Lastpage
159
Abstract
The convergence of the Shannon entropy in the countable infinity case is revisited and extended in this work. New results are presented that provide necessary and sufficient conditions for the convergence of the entropy in different settings, including scenarios with both finitely and infinitely supported measures. These results show some connections between the Shannon entropy convergence and the convergence in information divergence.
Keywords
entropy; Shannon entropy convergence; countable infinite case; information divergence; Context; Convergence; Entropy; Estimation; Information theory; Limiting; Topology;
fLanguage
English
Publisher
ieee
Conference_Titel
Information Theory Proceedings (ISIT), 2012 IEEE International Symposium on
Conference_Location
Cambridge, MA
ISSN
2157-8095
Print_ISBN
978-1-4673-2580-6
Electronic_ISBN
2157-8095
Type
conf
DOI
10.1109/ISIT.2012.6283535
Filename
6283535
Link To Document