DocumentCode
1018222
Title
A generalization of the entropy power inequality with applications
Author
Zamir, Ram ; Feder, Meir
Author_Institution
Dept. of Electr. Eng., Tel Aviv Univ., Israel
Volume
39
Issue
5
fYear
1993
fDate
9/1/1993 12:00:00 AM
Firstpage
1723
Lastpage
1728
Abstract
The authors prove the following generalization of the entropy power inequality: h(ax_)⩾h(Ax_) where h(·) denotes (joint-) differential-entropy x_=x1...xn , is a random vector with independent components, x˜_=x˜...x˜n, is a Gaussian vector with independent components such that h(x¯i)=h(xi ), i=1...n, and A is any matrix. This generalization of the entropy-power inequality is applied to show that a non-Gaussian vector with independent components becomes “closer” to Gaussianity after a linear transformation, where the distance to Gaussianity is measured by the information divergence. Another application is a lower bound, greater than zero, for the mutual-information between nonoverlapping spectral components of a non-Gaussian white process. They also describe a dual generalization of the Fisher information inequality
Keywords
information theory; matrix algebra; spectral analysis; Fisher information inequality; Gaussian vector; differential-entropy; entropy power inequality; independent components; information divergence; linear transformation; lower bound; matrix; mutual information; nonGaussian vector; nonGaussian white process; nonoverlapping spectral components; random vector; Covariance matrix; Cramer-Rao bounds; Entropy; Gaussian distribution; Gaussian processes; Information theory; Linear matrix inequalities; Power measurement; Upper bound; Vectors;
fLanguage
English
Journal_Title
Information Theory, IEEE Transactions on
Publisher
ieee
ISSN
0018-9448
Type
jour
DOI
10.1109/18.259666
Filename
259666
Link To Document