• DocumentCode
    4234
  • Title

    Tight Bound on Relative Entropy by Entropy Difference

  • Author

    Reeb, David ; Wolf, Michael M.

  • Author_Institution
    Dept. of Math., Tech. Univ. Minchen, Garching, Germany
  • Volume
    61
  • Issue
    3
  • fYear
    2015
  • fDate
    Mar-15
  • Firstpage
    1458
  • Lastpage
    1473
  • Abstract
    We prove a lower bound on the relative entropy between two finite-dimensional states in terms of their entropy difference and the dimension of the underlying space. The inequality is tight in the sense that equality can be attained for any prescribed value of the entropy difference, both for quantum and classical systems. We outline implications for information theory and thermodynamics, such as a necessary condition for a process to be close to thermodynamic reversibility, or an easily computable lower bound on the classical channel capacity. Furthermore, we derive a tight upper bound, uniform for all states of a given dimension, on the variance of the surprisal, whose thermodynamic meaning is that of heat capacity.
  • Keywords
    channel capacity; entropy; multidimensional systems; specific heat; thermodynamics; channel capacity; finite-dimensional state; heat capacity; information theory; lower bound; quantum system; relative entropy difference; thermodynamic reversibility; tight upper bound; Entropy; Heating; Information theory; Probability distribution; Reactive power; Thermodynamics; Upper bound; Relative entropy; channel capacity; entropy inequalities; heat capacity; relative entropy; surprisal; thermodynamics;
  • fLanguage
    English
  • Journal_Title
    Information Theory, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9448
  • Type

    jour

  • DOI
    10.1109/TIT.2014.2387822
  • Filename
    7001656