Title :
Asymptotically efficient estimation of prior probabilities in multiclass finite mixtures
Author :
Dattatreya, G.R. ; Kanal, Laveen N.
Author_Institution :
Texas Univ., Richardson, TX, USA
fDate :
5/1/1991 12:00:00 AM
Abstract :
A prior probability estimator, a candidate for asymptotic efficiency, from within the class of recursive estimators proposed by the authors (1990) is synthesized. The authors prove asymptotic efficiency and convergence with probability one by involving a stochastic approximation theorem. The estimator can be implemented in practice for continuous, discrete, and mixed class conditional density functions, although continuous and mixed densities generally require repeated evaluation of expectations of certain functions through numerical techniques. Results of a simulation. experiment with discrete densities are included. Variations of the estimator, for computational simplicity, are discussed.
Keywords :
convergence; information theory; parameter estimation; probability; stochastic processes; asymptotic efficiency; computational simplicity; continuous density functions; convergence; discrete density functions; information theory; mixed class conditional density functions; multiclass finite mixtures; numerical techniques; prior probability estimator; recursive estimators; stochastic approximation theorem; Computational modeling; Computer science; Convergence; Density functional theory; Distribution functions; Gain; Nonlinear equations; Probability distribution; Recursive estimation; Stochastic processes;
Journal_Title :
Information Theory, IEEE Transactions on