Title :
Unsupervised learning in noise
Author_Institution :
Dept. of Electr. Eng.-Syst., Univ. of Southern California, Los Angeles, CA, USA
Abstract :
The structural stability of real-time unsupervised learning in feedback dynamical systems is demonstrated with the Ito-Stratonovich stochastic calculus. Structural stability allows globally stable feedback systems to be perturbed without changing their qualitative equilibrium behavior. This increases the reliability and biological plausibility of large-scale hardware implementations of such networks. These structurally stable dynamical systems are called random adaptive bidirectional associative memory (RABAM) models. RABAM models include several popular nonadaptive and adaptive feedback models, such as the Hopfield circuit and the ART-2 model. A new hybrid unsupervised-learning law, called the differential competitive law, which uses the signal velocity as a local unsupervised reinforcement mechanism, is introduced, and its coding and stability behavior in feedforward and feedback networks is studied.<>
Keywords :
calculus; content-addressable storage; learning systems; neural nets; noise; stability; stochastic processes; ART-2 model; Hopfield circuit; Ito-Stratonovich stochastic calculus; adaptive feedback; biological plausibility; feedback dynamical systems; globally stable feedback systems; noise; nonadaptive feedback; random adaptive bidirectional associative memory; real-time unsupervised learning; reliability; signal velocity; structural stability; Associative memories; Calculus; Learning systems; Neural networks; Noise; Stability; Stochastic processes;
Conference_Titel :
Neural Networks, 1989. IJCNN., International Joint Conference on
Conference_Location :
Washington, DC, USA
DOI :
10.1109/IJCNN.1989.118553