Title :
Online learning with recycled examples: a cavity analysis
Author :
Luo, Peixun ; Wong, K. Y Michael
Author_Institution :
Dept. of Phys., Hong Kong Univ. of Sci. & Technol., Kowloon, China
Abstract :
We analyse the dynamics of on-line learning with recycled examples using the cavity method. For large input dimensions, we derive equations for the macroscopic parameters, providing solutions to Adaline learning as a benchmark. Comparison with batch learning is discussed.
Keywords :
Green´s function methods; generalisation (artificial intelligence); learning by example; neural nets; Adaline learning; Green function; cavity method; generalization; learning dynamics; online learning; recycled examples; Equations; History; Monte Carlo methods; Performance analysis; Physics; Steady-state; Water conservation;
Conference_Titel :
Neural Information Processing, 2002. ICONIP '02. Proceedings of the 9th International Conference on
Print_ISBN :
981-04-7524-1
DOI :
10.1109/ICONIP.2002.1202839
