Title :
A novelty Bayesian method for unsupervised learning of finite mixture models
Author :
Dai, Hui ; Ma, Wei-min
Author_Institution :
Sch. of Manage., Xi´´an Jiaotong Univ., China
Abstract :
Mixture models have universal applications in probabilistic modeling for multivariate data. This paper proposes a novelty parameters estimation and model selection method based on half Bayesian. In our algorithm, the mixture coefficient is a determinate variable, and the parameters of the components are random variables. Owing to the special prior distribution of the parameters, the parameters don´t converge toward a singular estimation at the boundary of the parameter space, and the redundant components can be automatically removed. In a word, our algorithm has very good performances as follows: (1) automatically selects the number of components, (2) avoids converging the boundary of the parameter space, (3) is less sensitive to initialization, (4) can fulfil simultaneously the parameters estimation and model selection in one algorithm, therefore, the computation efficiency is higher. The experimental results show that the algorithm is effective and has above good performances.
Keywords :
Bayes methods; parameter estimation; unsupervised learning; Bayesian method; finite mixture models; multivariate data; parameters estimation; probabilistic modeling; unsupervised learning; Bayesian methods; Clustering algorithms; Distributed computing; High performance computing; Image analysis; Machine learning algorithms; Parameter estimation; Random variables; Stochastic processes; Unsupervised learning;
Conference_Titel :
Machine Learning and Cybernetics, 2004. Proceedings of 2004 International Conference on
Print_ISBN :
0-7803-8403-2
DOI :
10.1109/ICMLC.2004.1380410