Title :
A New Data Processing Inequality and Its Applications in Distributed Source and Channel Coding
Author :
Kang, Wei ; Ulukus, Sennur
Abstract :
In the distributed coding of correlated sources, the problem of characterizing the joint probability distribution of a pair of random variables satisfying an n-letter Markov chain arises. The exact solution of this problem is intractable. In this paper, we seek a single-letter necessary condition for this n-letter Markov chain. To this end, we propose a new data processing inequality on a new measure of correlation through a spectral method. Based on this new data processing inequality, we provide a single-letter necessary condition for the required joint probability distribution. We apply our results to two specific examples involving the distributed coding of correlated sources: multiple-access channel with correlated sources and multiterminal rate-distortion region, and propose new necessary conditions for these two problems.
Keywords :
Markov processes; channel coding; probability; source coding; channel coding; correlated sources; data processing inequality; distributed source coding; joint probability distribution; multiple-access channel; multiterminal rate-distortion; n-letter Markov chain; spectral method; Correlation; Data processing; Eigenvalues and eigenfunctions; Joints; Markov processes; Probability distribution; Random variables; Correlated sources; data processing inequality; multiple-access channel; multiterminal rate-distortion region;
Journal_Title :
Information Theory, IEEE Transactions on
DOI :
10.1109/TIT.2010.2090211