Title :
Axiomatic geometry of conditional models
Author_Institution :
Sch. of Comput. Sci., Carnegie Mellon Univ., Pittsburgh, PA
fDate :
4/1/2005 12:00:00 AM
Abstract :
We formulate and prove an axiomatic characterization of the Riemannian geometry underlying manifolds of conditional models. The characterization holds for both normalized and nonnormalized conditional models. In the normalized case, the characterization extends the derivation of the Fisher information by Cencov while in the nonnormalized case it extends Campbell´s theorem. Due to the close connection between the conditional I-divergence and the product Fisher information metric, we provides a new axiomatic interpretation of the geometries underlying logistic regression and AdaBoost
Keywords :
Markov processes; geometry; information theory; probability; AdaBoost; Campbell´s theorem; Fisher information; Markov morphism; Riemannian geometry; axiomatic geometry; conditional I-divergence; conditional probability estimation; congruent embedding; information geometry; logistic regression; nonnormalized conditional model; normalized conditional models; Helium; Information geometry; Logistics; Mathematical model; Maximum likelihood estimation; Probability; Robustness; Solid modeling; Statistics; Testing; Conditional probability estimation; congruent embedding by a Markov morphism; information geometry;
Journal_Title :
Information Theory, IEEE Transactions on
DOI :
10.1109/TIT.2005.844060