Title :
Lower bounds on the rate-distortion function of individual LDGM codes
Author :
Kudekar, Shrinivas ; Urbanke, Rüdiger
Author_Institution :
Sch. of Comput. & Commun. Sci., Ecole Polytech. Fed. de Lausanne, Lausanne
Abstract :
We consider lossy compression of a binary symmetric source by means of a low-density generator-matrix code. We derive two lower bounds on the rate distortion function which are valid for any low-density generator-matrix code with a given node degree distribution L(x) on the set of generators and for any encoding algorithm. These bounds show that, due to the sparseness of the code, the performance is strictly bounded away from the Shannon rate-distortion function. In this sense, our bounds represent a natural generalization of Gallagerpsilas bound on the maximum rate at which low-density parity-check codes can be used for reliable transmission. Our bounds are inspired by the recent work of Dimakis, Wainwright, and Ramchandran, but they apply to individual codes.
Keywords :
data compression; encoding; parity check codes; rate distortion theory; Gallager bound; encoding algorithm; lossy compression; low-density generator-matrix code; low-density parity-check codes; node degree distribution; rate-distortion function; Belief propagation; Distributed computing; Iterative algorithms; Magnetic resonance; Parity check codes; Random variables; Rate distortion theory; Rate-distortion; Sparse matrices; Turbo codes;
Conference_Titel :
Turbo Codes and Related Topics, 2008 5th International Symposium on
Conference_Location :
Lausanne
Print_ISBN :
978-1-4244-2862-5
Electronic_ISBN :
978-1-4244-2863-2
DOI :
10.1109/TURBOCODING.2008.4658729