DocumentCode
1355088
Title
Structural stability of unsupervised learning in feedback neural networks
Author
Kosko, Bart
Author_Institution
Dept. of Electr. Eng., Southern California Univ, Los Angeles, CA, USA
Volume
36
Issue
7
fYear
1991
fDate
7/1/1991 12:00:00 AM
Firstpage
785
Lastpage
792
Abstract
Structural stability is proved for a large class of unsupervised nonlinear feedback neural networks, adaptive bidirectional associative memory (ABAM) models. The approach extends the ABAM models to the random-process domain as systems of stochastic differential equations and appends scaled Brownian diffusions. It is also proved that this much larger family of models, random ABAM (RABAM) models, is globally stable. Intuitively, RABAM equilibria equal ABAM equilibria that vibrate randomly. The ABAM family includes many unsupervised feedback and feedforward neural models. All RABAM models permit Brownian annealing. The RABAM noise suppression theorem characterizes RABAM system vibration. The mean-squared activation and synaptic velocities decrease exponentially to their lower hounds, the respective temperature-scaled noise variances. The many neuronal and synaptic parameters missing from such neural network models are included, but as net random unmodeled effects. They do not affect the structure of real-time global computations
Keywords
adaptive systems; content-addressable storage; feedback; learning systems; neural nets; random processes; stability; Brownian diffusions; adaptive bidirectional associative memory; feedback neural networks; mean-squared activation; random-process; stochastic differential equations; structural stability; synaptic velocities; unsupervised learning; Biological system modeling; Calculus; Differential equations; Intelligent networks; Neural networks; Neurofeedback; Stability; Stochastic processes; Structural engineering; Unsupervised learning;
fLanguage
English
Journal_Title
Automatic Control, IEEE Transactions on
Publisher
ieee
ISSN
0018-9286
Type
jour
DOI
10.1109/9.85058
Filename
85058
Link To Document