Title :
Operational Duality Between Lossy Compression and Channel Coding
Author :
Gupta, Ankit ; VerdÙ, Sergio
Author_Institution :
Samsung Telecommun. America, Richardson, TX, USA
fDate :
6/1/2011 12:00:00 AM
Abstract :
We explore the duality between lossy compression and channel coding in the operational sense: whether a capacity-achieving encoder-decoder sequence achieves the rate-distortion function of the dual problem when the channel decoder [encoder] is the source compressor [decompressor, resp.], and vice versa. We show that, if used as a lossy compressor, the maximum-likelihood channel decoder of a randomly chosen capacity-achieving codebook achieves the rate-distortion function almost surely. However, operational duality does not hold for every capacity achieving encoder-decoder sequence, or rate-distortion achieving compressor-decompressor sequence. We show that there exist optimal channel coding [lossy compression] schemes, which fail when used for the dual lossy compression [channel coding resp.] problem.
Keywords :
channel coding; maximum likelihood decoding; rate distortion theory; capacity-achieving encoder-decoder sequence; channel coding; lossy compression; maximum-likelihood channel decoder; operational duality; rate-distortion function; Channel coding; Cost function; Maximum likelihood decoding; Memoryless systems; Rate-distortion; Channel coding with cost constraints; discrete memoryless channels; discrete memoryless sources; lossy data compression; rate-distortion theory; source-channel coding duality;
Journal_Title :
Information Theory, IEEE Transactions on
DOI :
10.1109/TIT.2011.2136910