• DocumentCode
    1684492
  • Title

    Maximum entropy estimation of the probability density function from the histogram using order statistic constraints

  • Author

    Kirlin, R. Lynn ; Reza, Ali M.

  • Author_Institution
    Dept. of Electr. Eng., Univ. of Victoria, Victoria, BC, Canada
  • fYear
    2013
  • Firstpage
    6407
  • Lastpage
    6410
  • Abstract
    An analytical expression for a probability density is usually required in detection and estimation problems, yet it is usually only assumed or selected from contenders by parameter estimation, or the histogram is smoothed with an arbitrary window function. In contrast, given a histogram containing R sample points, we derive a nonlinear differential equation (NDEQ) whose solution is a maximum entropy density given constraints that arise from assumptions that the samples are means of the order statistics of the parent distribution. We solve the NDEQ for R=1 and approximate the solution for general R using the fact that order means partition the density into equal probability regions, which we require to independently be maximum entropy. Finally we show with a Rayleigh density example what errors may result.
  • Keywords
    maximum entropy methods; nonlinear differential equations; optimisation; parameter estimation; probability; NDEQ; Rayleigh density; arbitrary window function; detection problems; equal probability regions; estimation problems; histogram; maximum entropy density; maximum entropy estimation; nonlinear differential equation; optimization; order means; order statistic constraints; parameter estimation; parent distribution; probability density function; Approximation methods; Density functional theory; Differential equations; Entropy; Estimation; Histograms; Probability; estimation of probability density function; histogram; maximum entropy; order statistics;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Acoustics, Speech and Signal Processing (ICASSP), 2013 IEEE International Conference on
  • Conference_Location
    Vancouver, BC
  • ISSN
    1520-6149
  • Type

    conf

  • DOI
    10.1109/ICASSP.2013.6638899
  • Filename
    6638899