DocumentCode
31351
Title
Smooth Max-Information as One-Shot Generalization for Mutual Information
Author
Ciganovic, Nikola ; Beaudry, Normand J. ; Renner, Renato
Author_Institution
Dept. of Bioeng., Imperial Coll. London, London, UK
Volume
60
Issue
3
fYear
2014
fDate
Mar-14
Firstpage
1573
Lastpage
1581
Abstract
We study formal properties of smooth max-information, a generalization of von Neumann mutual information derived from the max-relative entropy. Recent work suggests that it is a useful quantity in one-shot channel coding, quantum rate distortion theory, and the physics of quantum many-body systems. Max-information can be defined in multiple ways. We demonstrate that different smoothed definitions are essentially equivalent (up to logarithmic terms in the smoothing parameters). These equivalence relations allow us to derive new chain rules for the max-information in terms of min- and max-entropies, thus extending the smooth entropy formalism to mutual information.
Keywords
channel coding; information theory; smoothing methods; logarithmic terms; max-relative entropy; one-shot channel coding; one-shot generalization; quantum many-body systems; quantum rate distortion theory; smooth entropy formalism; smooth max-information; smoothing parameters; von Neumann mutual information; Entropy; Hilbert space; Mutual information; Quantum mechanics; Smoothing methods; Chain rules; mutual information; one-shot information theory; smooth entropy;
fLanguage
English
Journal_Title
Information Theory, IEEE Transactions on
Publisher
ieee
ISSN
0018-9448
Type
jour
DOI
10.1109/TIT.2013.2295314
Filename
6687244
Link To Document