Title :
Exact solution for the conditional entropy of Poissonian LDPC codes over the Binary Erasure Channel
Author :
Korada, S.B. ; Kudekar, S. ; Macris, N.
Author_Institution :
Sch. of Comput. & Commun. Sci., Ecole Tech. Fed. de Lausanne, Lausanne
Abstract :
We consider communication over a binary erasure channel with low density parity check codes and optimal maximum a posteriori decoding. It is known that the problem of computing the average conditional entropy, over such code ensembles, in the asymptotic limit of large block length is closely related to computing the free energy of a mean field spin glass in the thermodynamic limit. Tentative, but explicit, formulas for these quantities have been derived thanks to the replica method (of spin glass theory) and are generally conjectured to be exact. In this contribution we show that the replica formulas are indeed exact in the case of Poissonian low density parity check ensembles. Our methods use ideas coming from the recent progress in the rigorous analysis of the Sherrington-Kirkpatrick model and their applications to the theory of error correcting codes.
Keywords :
decoding; entropy codes; error correction codes; parity check codes; stochastic processes; Poissonian LDPC codes; Poissonian low density parity check ensembles; Sherrington-Kirkpatrick model; average conditional entropy; binary erasure channel; code ensembles; decoding; error correcting codes; large block length; low density parity check codes; mean field spin glass; replica formulas; rigorous analysis; spin glass theory; thermodynamic limit; Belief propagation; Decoding; Entropy; Error correction codes; Glass; Interpolation; Linear code; Message passing; Parity check codes; Thermodynamics;
Conference_Titel :
Information Theory, 2007. ISIT 2007. IEEE International Symposium on
Conference_Location :
Nice
Print_ISBN :
978-1-4244-1397-3
DOI :
10.1109/ISIT.2007.4557357