Title :
A kurtosis-based dynamic approach to Gaussian mixture modeling
Author :
Vlassis, Nikos ; Likas, Aristidis
Author_Institution :
Dept. of Comput. Sci., Amsterdam Univ., Netherlands
fDate :
7/1/1999 12:00:00 AM
Abstract :
We address the problem of probability density function estimation using a Gaussian mixture model updated with the expectation-maximization (EM) algorithm. To deal with the case of an unknown number of mixing kernels, we define a new measure for Gaussian mixtures, called total kurtosis, which is based on the weighted sample kurtoses of the kernels. This measure provides an indication of how well the Gaussian mixture fits the data. Then we propose a new dynamic algorithm for Gaussian mixture density estimation which monitors the total kurtosis at each step of the EM algorithm in order to decide dynamically on the correct number of kernels and possibly escape from local maxima. We show the potential of our technique in approximating unknown densities through a series of examples with several density estimation problems
Keywords :
Gaussian distribution; maximum likelihood estimation; EM algorithm; Gaussian mixture density estimation; Gaussian mixture modeling; expectation-maximization algorithm; kurtosis-based dynamic approach; mixing kernels; probability density function estimation; total kurtosis; weighted sample kurtoses; Approximation algorithms; Computer science; Feedforward neural networks; Heuristic algorithms; Humans; Iterative algorithms; Kernel; Maximum likelihood estimation; Neural networks; Probability density function;
Journal_Title :
Systems, Man and Cybernetics, Part A: Systems and Humans, IEEE Transactions on
DOI :
10.1109/3468.769758