DocumentCode :
946209
Title :
A new derivation of the entropy expressions
Author :
Golomb, Solomon W.
Volume :
7
Issue :
3
fYear :
1961
fDate :
7/1/1961 12:00:00 AM
Firstpage :
166
Lastpage :
167
Abstract :
In the discrete case, the Shannon expression for entropy is obtained as a line integral in probability space. The integrand is the "information density vector" ( \\log p_1, \\log p_2, \\cdots , \\log p_n) . In the continuous case, the continuous analog of information density is integrated to obtain the entropy expression for continuous probability distributions.
Keywords :
Entropy functions; Contracts; Density measurement; Eigenvalues and eigenfunctions; Entropy; Equations; Frequency; Information theory; Integral equations; Laboratories; Probability distribution; Propulsion; Space technology; Vectors;
fLanguage :
English
Journal_Title :
Information Theory, IRE Transactions on
Publisher :
ieee
ISSN :
0096-1000
Type :
jour
DOI :
10.1109/TIT.1961.1057631
Filename :
1057631
Link To Document :
بازگشت