Title :
About the mutual (conditional) information
Author :
Renner, Renato ; Maurer, Ueli
Author_Institution :
Inst. of Theor. Comput. Sci., Eidgenossische Tech. Hochschule, Zurich, Switzerland
Abstract :
We give a necessary, sufficient, and easily verifiable criterion for the conditional probability distribution PZ|XY (where X, Y and Z are arbitrary random variables), such that I(X; Y)≥I(X; Y|Z) holds for any distribution PXY. Furthermore, the result is generalized to the case where Z is specified by a conditional probability distribution depending on more than two random variables.
Keywords :
information theory; probability; random processes; arbitrary random variables; conditional probability distribution; mutual information; Computer science; Information theory; Mutual information; Probability distribution; Random variables;
Conference_Titel :
Information Theory, 2002. Proceedings. 2002 IEEE International Symposium on
Print_ISBN :
0-7803-7501-7
DOI :
10.1109/ISIT.2002.1023636