DocumentCode :
754301
Title :
Axiomatic geometry of conditional models
Author :
Lebanon, Guy
Author_Institution :
Sch. of Comput. Sci., Carnegie Mellon Univ., Pittsburgh, PA
Volume :
51
Issue :
4
fYear :
2005
fDate :
4/1/2005 12:00:00 AM
Firstpage :
1283
Lastpage :
1294
Abstract :
We formulate and prove an axiomatic characterization of the Riemannian geometry underlying manifolds of conditional models. The characterization holds for both normalized and nonnormalized conditional models. In the normalized case, the characterization extends the derivation of the Fisher information by Cencov while in the nonnormalized case it extends Campbell´s theorem. Due to the close connection between the conditional I-divergence and the product Fisher information metric, we provides a new axiomatic interpretation of the geometries underlying logistic regression and AdaBoost
Keywords :
Markov processes; geometry; information theory; probability; AdaBoost; Campbell´s theorem; Fisher information; Markov morphism; Riemannian geometry; axiomatic geometry; conditional I-divergence; conditional probability estimation; congruent embedding; information geometry; logistic regression; nonnormalized conditional model; normalized conditional models; Helium; Information geometry; Logistics; Mathematical model; Maximum likelihood estimation; Probability; Robustness; Solid modeling; Statistics; Testing; Conditional probability estimation; congruent embedding by a Markov morphism; information geometry;
fLanguage :
English
Journal_Title :
Information Theory, IEEE Transactions on
Publisher :
ieee
ISSN :
0018-9448
Type :
jour
DOI :
10.1109/TIT.2005.844060
Filename :
1412025
Link To Document :
بازگشت