Title :
Sampling from a multivariate Gaussian distribution truncated on a simplex: A review
Author :
Altmann, Yoann ; McLaughlin, Steve ; Dobigeon, Nicolas
Author_Institution :
Sch. of Eng. & Phys. Sci., Heriot-Watt Univ., Edinburgh, UK
fDate :
June 29 2014-July 2 2014
Abstract :
In many Bayesian models, the posterior distribution of interest is a multivariate Gaussian distribution restricted to a specific domain. In particular, when the unknown parameters to be estimated can be considered as proportions or probabilities, they must satisfy positivity and sum-to-one constraints. This paper reviews recent Monte Carlo methods for sampling from multivariate Gaussian distributions restricted to the standard simplex. First, a classical Gibbs sampler is presented. Then, two Hamiltonian Monte Carlo methods are described and analyzed. In a similar fashion to the Gibbs sampler, the first method has a acceptance rate equal to one whereas the second requires an accept/reject procedure. The performance of the three methods are compared through the use of a few examples.
Keywords :
Gaussian distribution; Markov processes; Monte Carlo methods; sampling methods; Bayesian models; Hamiltonian Monte Carlo methods; Markov chain Monte Carlo methods; classical Gibbs sampler; multivariate Gaussian distribution; positivity; posterior distribution; sum-to-one constraints; unknown parameter estimation; Conferences; Decision support systems; Hafnium; Signal processing; Zirconium; Constrained Hamiltonian Monte Carlo; Markov Chain Monte Carlo methods; truncated multivariate Gaussian distributions;
Conference_Titel :
Statistical Signal Processing (SSP), 2014 IEEE Workshop on
Conference_Location :
Gold Coast, VIC
DOI :
10.1109/SSP.2014.6884588