Title :
Unsupervised learning of Gaussian Mixture Models: Evolutionary Create and Eliminate for Expectation Maximization algorithm
Author :
Covoes, T.F. ; Hruschka, Estevam R.
Author_Institution :
Dept. of Comput. Sci., Univ. of Sao Paulo (USP), Sao Carlos, Brazil
Abstract :
This paper describes the Evolutionary Create & Eliminate for Expectation Maximization algorithm (ECE-EM) for learning finite Gaussian Mixture Models (GMMs). The proposed algorithm is a variant of the recently proposed Evolutionary Split & Merge for Expectation Maximization algorithm (ESM-EM). ECE-EM uses simpler guiding functions and mutation operators compared to ESM-EM, while keeping the appealing properties of its counterpart. As an additional contribution of our work, we compare, in eighteen datasets, both ECE-EM and ESM-EM with two state-of-the-art algorithms able to learn the structure and the parameters of GMMs. Our experimental results suggest that both evolutionary algorithms present a sound tradeoff between computational time and accuracy when compared to the other algorithms. Furthermore, ECE-EM was able to obtain results at least as good as those achieved by ESM-EM.
Keywords :
Gaussian processes; evolutionary computation; expectation-maximisation algorithm; unsupervised learning; ECE-EM; ESM-EM; GMM; evolutionary algorithm; evolutionary create & eliminate for expectation maximization algorithm; evolutionary split & merge for expectation maximization algorithm; finite Gaussian mixture model learning; guiding function operator; mutation operator; unsupervised learning; Algorithm design and analysis; Clustering algorithms; Covariance matrices; Gaussian mixture model; Matrix decomposition; Sociology;
Conference_Titel :
Evolutionary Computation (CEC), 2013 IEEE Congress on
Conference_Location :
Cancun
Print_ISBN :
978-1-4799-0453-2
Electronic_ISBN :
978-1-4799-0452-5
DOI :
10.1109/CEC.2013.6557962