Title :
On characterization of entropy function via information inequalities
Author :
Zhang, Zhen ; Yeung, Raymond W.
Author_Institution :
Commun. Sci. Inst., Univ. of Southern California, Los Angeles, CA, USA
Abstract :
The properties of the so-called basic information inequalities of Shannon´s information measures are discussed. Do these properties fully characterize the entropy function? To make this question more precise, we view an entropy function as a 2n-1 dimensional vector where the coordinates are indexed by the subsets of the ground set (1, 2, ..., n). The main discovery of this paper is a new information inequality involving 4 discrete random variables which gives a negative answer to this fundamental problem of information theory
Keywords :
entropy; functional analysis; random processes; Shannon´s information measures; discrete random variables; entropy function; ground set; information inequalities; information theory; vector coordinates; Cramer-Rao bounds; Entropy; Information theory; Iron; Mutual information; Random variables;
Conference_Titel :
Information Theory, 1998. Proceedings. 1998 IEEE International Symposium on
Conference_Location :
Cambridge, MA
Print_ISBN :
0-7803-5000-6
DOI :
10.1109/ISIT.1998.708980