DocumentCode :
1684492
Title :
Maximum entropy estimation of the probability density function from the histogram using order statistic constraints
Author :
Kirlin, R. Lynn ; Reza, Ali M.
Author_Institution :
Dept. of Electr. Eng., Univ. of Victoria, Victoria, BC, Canada
fYear :
2013
Firstpage :
6407
Lastpage :
6410
Abstract :
An analytical expression for a probability density is usually required in detection and estimation problems, yet it is usually only assumed or selected from contenders by parameter estimation, or the histogram is smoothed with an arbitrary window function. In contrast, given a histogram containing R sample points, we derive a nonlinear differential equation (NDEQ) whose solution is a maximum entropy density given constraints that arise from assumptions that the samples are means of the order statistics of the parent distribution. We solve the NDEQ for R=1 and approximate the solution for general R using the fact that order means partition the density into equal probability regions, which we require to independently be maximum entropy. Finally we show with a Rayleigh density example what errors may result.
Keywords :
maximum entropy methods; nonlinear differential equations; optimisation; parameter estimation; probability; NDEQ; Rayleigh density; arbitrary window function; detection problems; equal probability regions; estimation problems; histogram; maximum entropy density; maximum entropy estimation; nonlinear differential equation; optimization; order means; order statistic constraints; parameter estimation; parent distribution; probability density function; Approximation methods; Density functional theory; Differential equations; Entropy; Estimation; Histograms; Probability; estimation of probability density function; histogram; maximum entropy; order statistics;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Acoustics, Speech and Signal Processing (ICASSP), 2013 IEEE International Conference on
Conference_Location :
Vancouver, BC
ISSN :
1520-6149
Type :
conf
DOI :
10.1109/ICASSP.2013.6638899
Filename :
6638899
Link To Document :
بازگشت