Title :
On the inverse problem of entropy maximizations (Corresp.)
Author :
Noonan, J.P. ; Tzannes, N.S. ; Costello, T.
fDate :
1/1/1976 12:00:00 AM
Abstract :
The inverse isoperimetric problem of the entropy functional is considered in this Correspondence. This problem can be stated as follows: Given a known probability density function (pdf), what prior constraints are needed in order for this pdf to be the one that maximizes the entropy functional? The solution is given in terms of a Theorem, and it is compared to the Rozenberg-Rubichev solution. The Theorem is also used in simple applications, one of which illuminates the relationship of the maximum entropy principle (MEP) to the concept of "relative frequencies."
Keywords :
Entropy functions; Artificial intelligence; Entropy; Frequency; Information theory; Inverse problems; Network address translation; Probability density function; Problem-solving; Rate distortion theory; Rate-distortion;
Journal_Title :
Information Theory, IEEE Transactions on
DOI :
10.1109/TIT.1976.1055497