Title :
-Divergence Estimation and Two-Sample Homogeneity Test Under Semiparametric Density-Ratio Models
Author :
Kanamori, Takafumi ; Suzuki, Taiji ; Sugiyama, Masashi
Author_Institution :
Dept. of Comput. Sci. & Math. Inf., Nagoya Univ., Nagoya, Japan
Abstract :
A density ratio is defined by the ratio of two probability densities. We study the inference problem of density ratios and apply a semiparametric density-ratio estimator to the two-sample homogeneity test. In the proposed test procedure, the f-divergence between two probability densities is estimated using a density-ratio estimator. The f -divergence estimator is then exploited for the two-sample homogeneity test. We derive an optimal estimator of f-divergence in the sense of the asymptotic variance in a semiparametric setting, and provide a statistic for two-sample homogeneity test based on the optimal estimator. We prove that the proposed test dominates the existing empirical likelihood score test. Through numerical studies, we illustrate the adequacy of the asymptotic theory for finite-sample inference.
Keywords :
probability; statistical testing; asymptotic theory; asymptotic variance; empirical likelihood score test; f-divergence estimation; finite-sample inference; inference problem; optimal estimator; probability density; semiparametric density-ratio estimator; two sample homogeneity test; Convergence; Estimation; Manganese; Optimized production technology; Probability distribution; Random variables; Asymptotic expansion; density ratio; divergence; semiparametric model; two-sample test;
Journal_Title :
Information Theory, IEEE Transactions on
DOI :
10.1109/TIT.2011.2163380