• DocumentCode
    31351
  • Title

    Smooth Max-Information as One-Shot Generalization for Mutual Information

  • Author

    Ciganovic, Nikola ; Beaudry, Normand J. ; Renner, Renato

  • Author_Institution
    Dept. of Bioeng., Imperial Coll. London, London, UK
  • Volume
    60
  • Issue
    3
  • fYear
    2014
  • fDate
    Mar-14
  • Firstpage
    1573
  • Lastpage
    1581
  • Abstract
    We study formal properties of smooth max-information, a generalization of von Neumann mutual information derived from the max-relative entropy. Recent work suggests that it is a useful quantity in one-shot channel coding, quantum rate distortion theory, and the physics of quantum many-body systems. Max-information can be defined in multiple ways. We demonstrate that different smoothed definitions are essentially equivalent (up to logarithmic terms in the smoothing parameters). These equivalence relations allow us to derive new chain rules for the max-information in terms of min- and max-entropies, thus extending the smooth entropy formalism to mutual information.
  • Keywords
    channel coding; information theory; smoothing methods; logarithmic terms; max-relative entropy; one-shot channel coding; one-shot generalization; quantum many-body systems; quantum rate distortion theory; smooth entropy formalism; smooth max-information; smoothing parameters; von Neumann mutual information; Entropy; Hilbert space; Mutual information; Quantum mechanics; Smoothing methods; Chain rules; mutual information; one-shot information theory; smooth entropy;
  • fLanguage
    English
  • Journal_Title
    Information Theory, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9448
  • Type

    jour

  • DOI
    10.1109/TIT.2013.2295314
  • Filename
    6687244