• DocumentCode
    847230
  • Title

    Balanced information inequalities

  • Author

    Chan, Terence H.

  • Author_Institution
    Dept. of Electr. & Comput. Eng., Univ. of Toronto, Ont., Canada
  • Volume
    49
  • Issue
    12
  • fYear
    2003
  • Firstpage
    3261
  • Lastpage
    3267
  • Abstract
    In this correspondence, we are interested in linear information inequalities, both discrete and continuous ones. We show that every discrete information inequality is associated with a "balanced" information inequality and a set of "residual weights." To prove the inequality, it is necessary and sufficient to prove that its "balanced" version is valid and all its residual weights are nonnegative. For a continuous information inequality, we prove that it is valid if and only if its discrete counterpart is balanced and valid.
  • Keywords
    entropy; group theory; information theory; probability; balanced information inequality; discrete information inequality; group inequality; linear information inequality; quasiuniform random variable; residual weight; Channel coding; Codes; Cramer-Rao bounds; Entropy; Information theory; Mutual information; Random variables;
  • fLanguage
    English
  • Journal_Title
    Information Theory, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9448
  • Type

    jour

  • DOI
    10.1109/TIT.2003.820037
  • Filename
    1255551