• DocumentCode
    3118100
  • Title

    Shannon entropy convergence results in the countable infinite case

  • Author

    Silva, Jorge F. ; Parada, Patricio A.

  • Author_Institution
    Dept. of Electr. Eng., Univ. of Chile, Santiago, Chile
  • fYear
    2012
  • fDate
    1-6 July 2012
  • Firstpage
    155
  • Lastpage
    159
  • Abstract
    The convergence of the Shannon entropy in the countable infinity case is revisited and extended in this work. New results are presented that provide necessary and sufficient conditions for the convergence of the entropy in different settings, including scenarios with both finitely and infinitely supported measures. These results show some connections between the Shannon entropy convergence and the convergence in information divergence.
  • Keywords
    entropy; Shannon entropy convergence; countable infinite case; information divergence; Context; Convergence; Entropy; Estimation; Information theory; Limiting; Topology;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Information Theory Proceedings (ISIT), 2012 IEEE International Symposium on
  • Conference_Location
    Cambridge, MA
  • ISSN
    2157-8095
  • Print_ISBN
    978-1-4673-2580-6
  • Electronic_ISBN
    2157-8095
  • Type

    conf

  • DOI
    10.1109/ISIT.2012.6283535
  • Filename
    6283535