Title :
Learning by Natural Gradient on Noncompact Matrix-Type Pseudo-Riemannian Manifolds
Author_Institution :
Dipt. di Ing. Biomedica, Elettron. e Telecomun. (DiBET), Univ. Politec. delle Marche, Ancona, Italy
fDate :
5/1/2010 12:00:00 AM
Abstract :
This paper deals with learning by natural-gradient optimization on noncompact manifolds. In a Riemannian manifold, the calculation of entities such as the closed form of geodesic curves over noncompact manifolds might be infeasible. For this reason, it is interesting to study the problem of learning by optimization over noncompact manifolds endowed with pseudo-Riemannian metrics, which may give rise to tractable calculations. A general theory for natural-gradient-based learning on noncompact manifolds as well as specific cases of interest of learning are discussed.
Keywords :
gradient methods; learning (artificial intelligence); matrix algebra; optimisation; Riemannian manifolds; natural-gradient optimization; natural-gradient-based learning; noncompact manifolds; pseudoRiemannian metrics; Geodesic stepping; learning by optimization; learning on noncompact manifolds; natural gradient; Algorithms; Artificial Intelligence; Humans; Learning; Neural Networks (Computer);
Journal_Title :
Neural Networks, IEEE Transactions on
DOI :
10.1109/TNN.2010.2043445