Title :
The variational approximation for Bayesian inference
Author :
Tzikas, Dimitris G. ; Likas, Aristidis C. ; Galatsanos, Nickolaos P.
Author_Institution :
Dept. of Comput. Sci., Univ. of Ioannina, Ioannina
fDate :
11/1/2008 12:00:00 AM
Abstract :
The influence of this Thomas Bayes\´ work was immense. It was from here that "Bayesian" ideas first spread through the mathematical world, as Bayes\´s own article was ignored until 1780 and played no important role in scientific debate until the 20th century. It was also this article of Laplace\´s that introduced the mathematical techniques for the asymptotic analysis of posterior distributions that are still employed today. And it was here that the earliest example of optimum estimation can be found, the derivation and characterization of an estimator that minimized a particular measure of posterior expected loss. After more than two centuries, we mathematicians, statisticians cannot only recognize our roots in this masterpiece of our science, we can still learn from it.
Keywords :
Bayes methods; approximation theory; belief networks; history; inference mechanisms; variational techniques; Bayes theorem; Bayesian inference; Laplace method; variational approximation; Approximation algorithms; Autobiographies; Bayesian methods; Inference algorithms; Iterative algorithms; Life estimation; Loss measurement; Maximum likelihood estimation; Particle measurements; Signal processing algorithms;
Journal_Title :
Signal Processing Magazine, IEEE
Conference_Location :
11/1/2008 12:00:00 AM
DOI :
10.1109/MSP.2008.929620