• DocumentCode
    2061857
  • Title

    The information topology

  • Author

    Harremoës, Peter

  • Author_Institution
    Dept. of Math., Copenhagen Univ., Denmark
  • fYear
    2002
  • fDate
    2002
  • Firstpage
    431
  • Abstract
    If (Qn)n∈N is a sequence of probability distributions, we say that (Qn)n∈N converges to Q in information, if D(Qn||Q)→0 for n→∞, where D(P||Q)=∫ log(dP/dQ)dP is the information divergence from P to Q. Convergence in information has been proved in many cases of statistical importance. On the set of probability distributions M+1 (Ω,B) there exists several relevant topologies. For instance the strong topology is defined by the total variation norm ||P-Q||=sup|f|≤1{∫ΩfdP-∫ΩfdQ}. Since it has long been known that the divergence balls B(Q, r)={P∈M+1 (Ω,B) | D(P || Q)\n\n\t\t
  • Keywords
    convergence; entropy; information theory; probability; topology; convergence; divergence balls; entropy function; information divergence; information theory; information topology; neighborhood filter; probability distributions; strong topology; total variation norm; Convergence; Entropy; Filtering theory; Information filtering; Information filters; Information theory; Probability distribution; Topology;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Information Theory, 2002. Proceedings. 2002 IEEE International Symposium on
  • Print_ISBN
    0-7803-7501-7
  • Type

    conf

  • DOI
    10.1109/ISIT.2002.1023703
  • Filename
    1023703