DocumentCode :
2300921
Title :
Proof of replica formulas in the high noise regime for communication using LDGM codes
Author :
Kudekar, Shrinivas ; Macris, Nicolas
Author_Institution :
Sch. of Comput. & Commun. Sci., Ecole Polytech. Fed. de Lausanne, Lausanne
fYear :
2008
fDate :
5-9 May 2008
Firstpage :
416
Lastpage :
420
Abstract :
We consider communication over a binary input memoryless output symmetric channel with low density generator matrix codes and optimal maximum a posteriori decoding. It is known that the problem of computing the average conditional entropy, over such code ensembles in the asymptotic limit of large block length, is closely related to computing the free energy of a mean field spin glass in the thermodynamic limit. Tentative explicit formulas for these quantities have been derived thanks to the replica method (of spin glass theory) and are generally conjectured to be exact. In this contribution we show that the replica solution is indeed exact in the high noise regime, where it coincides with density evolution equations. Our method uses ideas coming from high temperature expansions in spin glass theory.
Keywords :
binary codes; entropy codes; maximum likelihood decoding; memoryless systems; parity check codes; LDGM codes; binary input memoryless output symmetric channel; conditional entropy; density evolution equations; high noise regime; low density generator matrix codes; mean field spin glass; optimal maximum a posteriori decoding; replica formulas; spin glass theory; temperature expansions; Decoding; Entropy; Equations; Glass; Interpolation; Noise generators; Noise level; Symmetric matrices; Temperature; Thermodynamics;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Information Theory Workshop, 2008. ITW '08. IEEE
Conference_Location :
Porto
Print_ISBN :
978-1-4244-2269-2
Electronic_ISBN :
978-1-4244-2271-5
Type :
conf
DOI :
10.1109/ITW.2008.4578698
Filename :
4578698
Link To Document :
بازگشت