Title :
Fisher information with respect to cumulants
Author :
Prasad, Sudhakar ; Menicucci, N.C.
Author_Institution :
Dept. of Phys. & Astron., Univ. of New Mexico, Albuquerque, NM, USA
fDate :
4/1/2004 12:00:00 AM
Abstract :
Fisher information is a measure of the best precision with which a parameter can be estimated from statistical data. It can also be defined for a continuous random variable without reference to any parameters, in which case it has a physically compelling interpretation of representing the highest precision with which the first cumulant of the random variable, i.e., its mean, can be estimated from its statistical realizations. We construct a complete hierarchy of information measures that determine the best precision with which all of the cumulants of a random variable-and thus its complete probability distribution-can be estimated from its statistical realizations. Several properties of these information measures and their generating functions are discussed.
Keywords :
estimation theory; higher order statistics; statistical distributions; Cramer-Rao lower bounds; complete probability distribution; continuous random variable; cumulants; fisher information; k-statistics; statistical estimation theory; Data mining; Estimation theory; Extraterrestrial measurements; Information analysis; Instruction sets; Parameter estimation; Physics; Probability density function; Random variables; Yield estimation;
Journal_Title :
Information Theory, IEEE Transactions on
DOI :
10.1109/TIT.2004.825034