Title :
Unified duality between channel capacity and rate distortion with state information
Author :
Chiang, Mung ; Cover, Thomas M.
Author_Institution :
Dept. of Electr. Eng., Stanford Univ., CA, USA
Abstract :
We show that the duality between channel capacity and data compression is retained when state information is available to the sender, to the receiver, to both, or to neither. We also present a unified theory for different cases of channel capacity with state information, which extends existing results to arbitrary pairs of i.i.d. state information (S1, S2) available at the sender and at the receiver, respectively. The general formula C=max(p(u, |s1))[I(U; S2, Y)-I(U; S1)] assumes the same form as the Wyner-Ziv rate distortion function with state information. The Wyner-Ziv formula also unifies four special cases of the rate distortion problem with the state information
Keywords :
channel capacity; data compression; duality (mathematics); rate distortion theory; Wyner-Ziv formula; channel capacity; data compression; duality; i.i.d. state information; rate distortion function; receiver; sender; unified theory; Channel capacity; Computer aided software engineering; Data compression; Decoding; Differential equations; Information systems; Memoryless systems; Rate-distortion; Source coding; State estimation;
Conference_Titel :
Information Theory, 2001. Proceedings. 2001 IEEE International Symposium on
Conference_Location :
Washington, DC
Print_ISBN :
0-7803-7123-2
DOI :
10.1109/ISIT.2001.936164