Title :
A new framework for modeling learning dynamics
Author :
Tong, Y.W. ; Wong, K. Y Michael ; Li, S.
Author_Institution :
Dept. of Phys., Hong Kong Univ. of Sci. & Technol., Kowloon, Hong Kong
Abstract :
An important issue in neural computing concerns the description of learning dynamics with macroscopic dynamical variables. Recent progress on online learning only addresses the often unrealistic case of an infinite training set. We introduce a new framework to model batch learning of restricted sets of examples, widely applicable to any learning cost function, and fully taking into account the temporal correlations introduced by the re-cycling of the examples. Here we illustrate the technique using the Adaline rule learning random of teacher-generated examples
Keywords :
gradient methods; learning (artificial intelligence); neural nets; real-time systems; Adaline rule; batch learning; cost function; learning dynamics; neural networks; online learning; temporal correlations; Algorithm design and analysis; Cost function; Hebbian theory; Iterative algorithms; Joining processes; Microscopy; Physics; Recycling;
Conference_Titel :
Neural Networks, 1999. IJCNN '99. International Joint Conference on
Conference_Location :
Washington, DC
Print_ISBN :
0-7803-5529-6
DOI :
10.1109/IJCNN.1999.831123