Title :
Initializing normal mixtures of densities
Author :
Grim, J. ; Novovicova, J. ; Pudil, P. ; Somol, P. ; Ferri, F.J.
Author_Institution :
Inst. of Inf. Theory & Autom., Acad. of Sci., Czech Republic
Abstract :
It is well known that log-likelihood function for finite mixtures usually has local maxima and therefore the iterative EM algorithm for maximum-likelihood estimation of mixtures may be starting-point dependent. In this paper we propose a method of choosing initial parameters of mixtures which includes two stages: 1) computation of nonparametric optimally smoothed kernel estimate of the unknown density; and 2) optimal weighting of the smoothed kernel estimate using essential kernels as the initial estimate of the mixture. All the optimization tasks make use of a suitably modified EM algorithm. The properties and computational aspects of the proposed method are illustrated by a numerical example and some application possibilities are considered
Keywords :
iterative methods; matrix algebra; maximum likelihood estimation; optimisation; pattern recognition; probability; EM algorithm; iterative algorithm; log-likelihood function; matrix algebra; maximum-likelihood estimation; nonparametric density estimation; normal density mixtures; optimal weighting; optimization; pattern recognition; probability density function; smoothed kernel estimate; Automation; Books; Content addressable storage; Convergence; Information theory; Iterative algorithms; Maximum likelihood estimation; Parameter estimation; Pattern recognition; Tellurium;
Conference_Titel :
Pattern Recognition, 1998. Proceedings. Fourteenth International Conference on
Conference_Location :
Brisbane, Qld.
Print_ISBN :
0-8186-8512-3
DOI :
10.1109/ICPR.1998.711292