DocumentCode
1793463
Title
Maximizing Rényi entropy rate
Author
Bunte, Christoph ; Lapidoth, Amos
Author_Institution
ETH Zurich, Zurich, Switzerland
fYear
2014
fDate
3-5 Dec. 2014
Firstpage
1
Lastpage
4
Abstract
Of all univariate distributions on the nonnegative reals of a given mean, the distribution that maximizes the Rényi entropy is Lomax. But the memoryless Lomax stochastic process does not maximize the Rényi entropy rate: For Rényi orders smaller than one the supremum of the Rényi entropy rates is infinite, and for orders larger than one it is the differential Shannon entropy of the exponential distribution, which is the distribution that maximizes the differential Shannon entropy subject to these constraints. This is shown to be a special case of a much more general principle.
Keywords
entropy; exponential distribution; optimisation; stochastic processes; Rényi entropy rate maximization; differential Shannon entropy; exponential distribution; memoryless Lomax stochastic process; univariate distributions; Electronic mail; Entropy; Joints; Probability density function; Random variables; Stochastic processes; Tin;
fLanguage
English
Publisher
ieee
Conference_Titel
Electrical & Electronics Engineers in Israel (IEEEI), 2014 IEEE 28th Convention of
Conference_Location
Eilat
Print_ISBN
978-1-4799-5987-7
Type
conf
DOI
10.1109/EEEI.2014.7005859
Filename
7005859
Link To Document