Title :
Smooth Max-Information as One-Shot Generalization for Mutual Information
Author :
Ciganovic, Nikola ; Beaudry, Normand J. ; Renner, Renato
Author_Institution :
Dept. of Bioeng., Imperial Coll. London, London, UK
Abstract :
We study formal properties of smooth max-information, a generalization of von Neumann mutual information derived from the max-relative entropy. Recent work suggests that it is a useful quantity in one-shot channel coding, quantum rate distortion theory, and the physics of quantum many-body systems. Max-information can be defined in multiple ways. We demonstrate that different smoothed definitions are essentially equivalent (up to logarithmic terms in the smoothing parameters). These equivalence relations allow us to derive new chain rules for the max-information in terms of min- and max-entropies, thus extending the smooth entropy formalism to mutual information.
Keywords :
channel coding; information theory; smoothing methods; logarithmic terms; max-relative entropy; one-shot channel coding; one-shot generalization; quantum many-body systems; quantum rate distortion theory; smooth entropy formalism; smooth max-information; smoothing parameters; von Neumann mutual information; Entropy; Hilbert space; Mutual information; Quantum mechanics; Smoothing methods; Chain rules; mutual information; one-shot information theory; smooth entropy;
Journal_Title :
Information Theory, IEEE Transactions on
DOI :
10.1109/TIT.2013.2295314