Title :
On a Construction of Entropic Vectors Using Lattice-Generated Distributions
Author :
Hassibi, B. ; Shadbakht, S.
Author_Institution :
California Inst. of Technol., Pasadena
Abstract :
The problem of determining the region of entropic vectors is a central one in information theory. There has been a great deal of interest in the development of non-Shannon information inequalities, which provide outer bounds to the aforementioned region; however, there has been less work on developing inner bounds. This paper develops an inner bound that applies to any number of random variables and which is tight for 2 and 3 random variables (the only cases where the entropy region is known). The construction is based on probability distributions generated by a lattice. The region is shown to be a polytope generated by a set of linear inequalities. Study of the region for 4 and more random variables is currently under investigation.
Keywords :
entropy; lattice theory; statistical distributions; vectors; entropic vector construction; information theory; lattice-generated distributions; linear inequalities; nonShannon information inequalities; probability distributions; Codes; Cramer-Rao bounds; Entropy; Information theory; Mutual information; Random variables; Vectors;
Conference_Titel :
Information Theory, 2007. ISIT 2007. IEEE International Symposium on
Conference_Location :
Nice
Print_ISBN :
978-1-4244-1397-3
DOI :
10.1109/ISIT.2007.4557096