DocumentCode
2020878
Title
Infinitely Many Information Inequalities
Author
Matus, F.
Author_Institution
Acad. of Sci. of the Czech Republic, Prague
fYear
2007
fDate
24-29 June 2007
Firstpage
41
Lastpage
44
Abstract
When finite, Shannon entropies of all sub vectors of a random vector are considered for the coordinates of an entropic point in Euclidean space. A linear combination of the coordinates gives rise to an unconstrained information inequality if it is nonnegative for all entropic points. With at least four variables no finite set of linear combinations generates all such inequalities. This is proved by constructing explicitly an infinite sequence of new linear information inequalities and a curve in a special geometric position to the halfspaces defined by the inequalities. The inequalities are constructed recurrently by adhesive pasting of restrictions of polymatroids and the curve ranges in the closure of a set of the entropic points.
Keywords
entropy; matrix algebra; vectors; Euclidean space; Shannon entropy; information inequality; polymatroids; random vector; Automation; Cramer-Rao bounds; Entropy; Information analysis; Information theory; Shape; Vectors;
fLanguage
English
Publisher
ieee
Conference_Titel
Information Theory, 2007. ISIT 2007. IEEE International Symposium on
Conference_Location
Nice
Print_ISBN
978-1-4244-1397-3
Type
conf
DOI
10.1109/ISIT.2007.4557201
Filename
4557201
Link To Document