• DocumentCode
    946209
  • Title

    A new derivation of the entropy expressions

  • Author

    Golomb, Solomon W.

  • Volume
    7
  • Issue
    3
  • fYear
    1961
  • fDate
    7/1/1961 12:00:00 AM
  • Firstpage
    166
  • Lastpage
    167
  • Abstract
    In the discrete case, the Shannon expression for entropy is obtained as a line integral in probability space. The integrand is the "information density vector" ( \\log p_1, \\log p_2, \\cdots , \\log p_n) . In the continuous case, the continuous analog of information density is integrated to obtain the entropy expression for continuous probability distributions.
  • Keywords
    Entropy functions; Contracts; Density measurement; Eigenvalues and eigenfunctions; Entropy; Equations; Frequency; Information theory; Integral equations; Laboratories; Probability distribution; Propulsion; Space technology; Vectors;
  • fLanguage
    English
  • Journal_Title
    Information Theory, IRE Transactions on
  • Publisher
    ieee
  • ISSN
    0096-1000
  • Type

    jour

  • DOI
    10.1109/TIT.1961.1057631
  • Filename
    1057631
    • Link To Document
    https://search.isc.ac/dl/search/defaultta.aspx?DTC=49&DC=946209