• DocumentCode
    640075
  • Title

    Approaching the rate-distortion limit by spatial coupling with belief propagation and decimation

  • Author

    Aref, Vahid ; Macris, Nicolas ; Vuffray, Marc

  • Author_Institution
    LTHC, EPFL, Lausanne, Switzerland
  • fYear
    2013
  • fDate
    7-12 July 2013
  • Firstpage
    1177
  • Lastpage
    1181
  • Abstract
    We investigate an encoding scheme for lossy compression based on spatially coupled Low-Density GeneratorMatrix codes. The degree distributions are regular, or are Poisson on the code-bit side and check-regular which allows use for any compression rate. The performance of a low complexity Belief Propagation Guided Decimation algorithm is excellent, and for large check degrees it gets close to Shannon´s rate-distortion limit. We investigate links between the algorithmic performance and the phase diagram of a relevant random Gibbs measure. The associated dynamical and condensation thresholds are computed within the framework of the cavity method. We observe that: (i) the dynamical threshold of the spatially coupled construction saturates towards the condensation threshold; (ii) for large degrees the condensation threshold approaches the information theoretic test-channel parameter of rate-distortion theory. This provides heuristic insight into the excellent performance of the BPGD algorithm.
  • Keywords
    bandwidth compression; source coding; BPGD algorithm; Poisson; Shannon rate-distortion limit; cavity method; code-bit side; condensation threshold approaches; condensation thresholds; dynamical thresholds; encoding scheme; information theoretic test-channel parameter; lossy compression; low complexity belief propagation guided decimation algorithm; random Gibbs measure; rate-distortion theory; spatial coupling; spatially coupled Low-Density GeneratorMatrix codes; Belief propagation; Cavity resonators; Channel coding; Complexity theory; Equations; Rate-distortion; LDGM; Lossy source coding; belief propagation guided decimation; rate distortion bound; spatial coupling;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Information Theory Proceedings (ISIT), 2013 IEEE International Symposium on
  • Conference_Location
    Istanbul
  • ISSN
    2157-8095
  • Type

    conf

  • DOI
    10.1109/ISIT.2013.6620412
  • Filename
    6620412