DocumentCode :
3506109
Title :
Connection between annealed free energy and belief propagation on random factor graph ensembles
Author :
Mori, Ryuhei
Author_Institution :
Grad. Sch. of Inf., Kyoto Univ., Kyoto, Japan
fYear :
2011
fDate :
July 31 2011-Aug. 5 2011
Firstpage :
2010
Lastpage :
2014
Abstract :
Recently, Vontobel showed the relationship between Bethe free energy and annealed free energy for protograph factor graph ensembles. In this paper, annealed free energy of any random regular factor graph ensembles are connected to Bethe free energy. The annealed free energy is expressed as the solution of maximization problem whose stationary condition coincides with equations of belief propagation since the contribution to partition function of particular type of variable and factor nodes has similar form of minus Bethe free energy. It gives simple derivation of quenched free energy by using the replica method. It implies equivalence of the replica and cavity methods for any random irregular factor graph ensembles. As consequence, it is shown that the replica symmetric solution and annealed free energy are equal for regular ensemble.
Keywords :
belief networks; free energy; graph theory; optimisation; replica techniques; Bethe free energy; annealed free energy; belief propagation; cavity methods; maximization problem; partition function; protograph factor graph ensembles; quenched free energy; random regular factor graph ensembles; replica method; replica symmetric solution; stationary condition; Annealing; Approximation methods; Cavity resonators; Entropy; Equations; Mathematical model;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Information Theory Proceedings (ISIT), 2011 IEEE International Symposium on
Conference_Location :
St. Petersburg
ISSN :
2157-8095
Print_ISBN :
978-1-4577-0596-0
Electronic_ISBN :
2157-8095
Type :
conf
DOI :
10.1109/ISIT.2011.6033907
Filename :
6033907
Link To Document :
بازگشت