Title :
Expectation propagation for estimating the parameters of the beta distribution
Author :
Ma, Zhanyu ; Leijon, Arne
Author_Institution :
Sound and Image Processing Lab, KTH - Royal Institute of Technology, Stockholm, Sweden
Abstract :
Parameter estimation for the beta distribution is analytically intractable due to the integration expression in the normalization constant. For maximum likelihood estimation, numerical methods can be used to calculate the parameters. For Bayesian estimation, we can utilize different approximations to the posterior parameter distribution. A method based on the variational inference (VI) framework reported the posterior mean of the parameters analytically but the approximating distribution violated the correlation between the parameters. We now propose a method via the expectation propagation (EP) framework to approximate the posterior distribution analytically and capture the correlation between the parameters. Compared to the method based on VI, the EP based algorithm performs better with small amounts of data and is more stable.
Keywords :
Acoustic propagation; Bayesian methods; Gaussian distribution; Image analysis; Image processing; Inference algorithms; Machine learning; Maximum likelihood estimation; Monte Carlo methods; Parameter estimation; Beta Distribution; Expectation Propagation; Importance Sampling; Laplace Approximation; Variational Inference;
Conference_Titel :
Acoustics Speech and Signal Processing (ICASSP), 2010 IEEE International Conference on
Conference_Location :
Dallas, TX, USA
Print_ISBN :
978-1-4244-4295-9
Electronic_ISBN :
1520-6149
DOI :
10.1109/ICASSP.2010.5495085