Title :
Balanced information inequalities
Author :
Chan, Terence H.
Author_Institution :
Dept. of Electr. & Comput. Eng., Univ. of Toronto, Ont., Canada
Abstract :
In this correspondence, we are interested in linear information inequalities, both discrete and continuous ones. We show that every discrete information inequality is associated with a "balanced" information inequality and a set of "residual weights." To prove the inequality, it is necessary and sufficient to prove that its "balanced" version is valid and all its residual weights are nonnegative. For a continuous information inequality, we prove that it is valid if and only if its discrete counterpart is balanced and valid.
Keywords :
entropy; group theory; information theory; probability; balanced information inequality; discrete information inequality; group inequality; linear information inequality; quasiuniform random variable; residual weight; Channel coding; Codes; Cramer-Rao bounds; Entropy; Information theory; Mutual information; Random variables;
Journal_Title :
Information Theory, IEEE Transactions on
DOI :
10.1109/TIT.2003.820037