Title :
Density estimation via exponential model selection
Author :
Castellan, Gwénaëlle
Author_Institution :
Lab. de Math. Appliquees, F.R.E. CNRS, Villeneuve d´´Ascq, France
Abstract :
We address the problem of estimating some unknown density on a bounded interval using some exponential models of piecewise polynomials. We consider a finite collection of such models based on a family of partitions. And we study the maximum-likelihood estimator built on a data-driven selected model among this collection. In doing so, we validate Akaike´s criterion if the partitions that we consider are regular and we modify it if the partitions are irregular. We deduce the rate of convergence of the squared Hellinger risk of our estimator in the regular case when the logarithm of the density belongs to some Besov space.
Keywords :
information theory; maximum likelihood estimation; polynomials; Akaike´s criterion; Besov space; bounded interval; data-driven selected model; density estimation; exponential model selection; maximum-likelihood estimator; partitions; piecewise polynomials; random variables; rate of convergence; squared Hellinger risk; Approximation error; Convergence; Density measurement; Maximum likelihood estimation; Neural networks; Polynomials; Random variables;
Journal_Title :
Information Theory, IEEE Transactions on
DOI :
10.1109/TIT.2003.814485