Title :
Density evolution for asymmetric memoryless channels
Author :
Wang, Chih-Chun ; Kulkarni, Sanjeev R. ; Poor, H. Vincent
Author_Institution :
Dept. of Electr. Eng., Princeton Univ., NJ, USA
Abstract :
Density evolution (DE) is one of the most powerful analytical tools for low-density parity-check (LDPC) codes and graph codes with message passing decoding algorithms. With channel symmetry as one of its fundamental assumptions, density evolution has been widely and successfully applied to different channels, including binary erasure channels (BECs), binary symmetric channels (BSCs), binary additive white Gaussian noise (BiAWGN) channels, etc. This paper generalizes density evolution for asymmetric memoryless channels, which in turn broadens the applications to general memoryless channels, e.g., z-channels, composite white Gaussian noise channels, etc. The central theorem underpinning this generalization is the convergence to perfect projection for any fixed-size supporting tree. A new iterative formula of the same complexity is then presented and the necessary theorems for the performance concentration theorems are developed. Several properties of the new density evolution method are explored, including stability results for general asymmetric memoryless channels. Simulations, code optimizations, and possible new applications suggested by this new density evolution method are also provided. This result is also used to prove the typicality of linear LDPC codes among the coset code ensemble when the minimum check node degree is sufficiently large. It is shown that the convergence to perfect projection is essential to the belief propagation (BP) algorithm even when only symmetric channels are considered. Hence, the proof of the convergence to perfect projection serves also as a completion of the theory of classical density evolution for symmetric memoryless channels.
Keywords :
AWGN channels; binary codes; channel coding; convergence of numerical methods; iterative decoding; linear codes; message passing; parity check codes; BEC; BSC; BiAWGN; belief propagation algorithm; binary additive white Gaussian noise channel; binary erasure channel; binary symmetric channel; convergence; density evolution method; graph code; iterative formula; linear LDPC code; low-density parity-check code; memoryless channel; message passing decoding algorithm; sum-product algorithm; Additive white noise; Algorithm design and analysis; Convergence; Decoding; Gaussian noise; Memoryless systems; Message passing; Optimization methods; Parity check codes; Stability; Asymmetric channels; density evolution (DE); low-density parity-check (LDPC) codes; rank of random matrices; sum–product algorithms; z-channels;
Journal_Title :
Information Theory, IEEE Transactions on
DOI :
10.1109/TIT.2005.858931