• DocumentCode
    3849626
  • Title

    Entropy Message Passing

  • Author

    Velimir M. Ilic;Miomir S. Stankovic;Branimir T. Todorovic

  • Author_Institution
    Department of Informatics, Faculty of Sciences and Mathematics, University of Ni?, Serbia
  • Volume
    57
  • Issue
    1
  • fYear
    2011
  • Firstpage
    375
  • Lastpage
    380
  • Abstract
    The paper proposes a new message passing algorithm for cycle-free factor graphs. The proposed "entropy message passing" (EMP) algorithm may be viewed as sum-product message passing over the entropy semiring, which has previously appeared in automata theory. The primary use of EMP is to compute the entropy of a model. However, EMP can also be used to compute expressions that appear in expectation maximization and in gradient-descent algorithms.
  • Keywords
    "Entropy","Message passing","Computational modeling","Signal processing algorithms","Probabilistic logic","Hidden Markov models","Sum product algorithm"
  • Journal_Title
    IEEE Transactions on Information Theory
  • Publisher
    ieee
  • ISSN
    0018-9448
  • Type

    jour

  • DOI
    10.1109/TIT.2010.2090235
  • Filename
    5673956
    • Link To Document
    https://search.isc.ac/dl/search/defaultta.aspx?DTC=49&DC=3849626