DocumentCode :
2020878
Title :
Infinitely Many Information Inequalities
Author :
Matus, F.
Author_Institution :
Acad. of Sci. of the Czech Republic, Prague
fYear :
2007
fDate :
24-29 June 2007
Firstpage :
41
Lastpage :
44
Abstract :
When finite, Shannon entropies of all sub vectors of a random vector are considered for the coordinates of an entropic point in Euclidean space. A linear combination of the coordinates gives rise to an unconstrained information inequality if it is nonnegative for all entropic points. With at least four variables no finite set of linear combinations generates all such inequalities. This is proved by constructing explicitly an infinite sequence of new linear information inequalities and a curve in a special geometric position to the halfspaces defined by the inequalities. The inequalities are constructed recurrently by adhesive pasting of restrictions of polymatroids and the curve ranges in the closure of a set of the entropic points.
Keywords :
entropy; matrix algebra; vectors; Euclidean space; Shannon entropy; information inequality; polymatroids; random vector; Automation; Cramer-Rao bounds; Entropy; Information analysis; Information theory; Shape; Vectors;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Information Theory, 2007. ISIT 2007. IEEE International Symposium on
Conference_Location :
Nice
Print_ISBN :
978-1-4244-1397-3
Type :
conf
DOI :
10.1109/ISIT.2007.4557201
Filename :
4557201
Link To Document :
بازگشت