• DocumentCode
    1355088
  • Title

    Structural stability of unsupervised learning in feedback neural networks

  • Author

    Kosko, Bart

  • Author_Institution
    Dept. of Electr. Eng., Southern California Univ, Los Angeles, CA, USA
  • Volume
    36
  • Issue
    7
  • fYear
    1991
  • fDate
    7/1/1991 12:00:00 AM
  • Firstpage
    785
  • Lastpage
    792
  • Abstract
    Structural stability is proved for a large class of unsupervised nonlinear feedback neural networks, adaptive bidirectional associative memory (ABAM) models. The approach extends the ABAM models to the random-process domain as systems of stochastic differential equations and appends scaled Brownian diffusions. It is also proved that this much larger family of models, random ABAM (RABAM) models, is globally stable. Intuitively, RABAM equilibria equal ABAM equilibria that vibrate randomly. The ABAM family includes many unsupervised feedback and feedforward neural models. All RABAM models permit Brownian annealing. The RABAM noise suppression theorem characterizes RABAM system vibration. The mean-squared activation and synaptic velocities decrease exponentially to their lower hounds, the respective temperature-scaled noise variances. The many neuronal and synaptic parameters missing from such neural network models are included, but as net random unmodeled effects. They do not affect the structure of real-time global computations
  • Keywords
    adaptive systems; content-addressable storage; feedback; learning systems; neural nets; random processes; stability; Brownian diffusions; adaptive bidirectional associative memory; feedback neural networks; mean-squared activation; random-process; stochastic differential equations; structural stability; synaptic velocities; unsupervised learning; Biological system modeling; Calculus; Differential equations; Intelligent networks; Neural networks; Neurofeedback; Stability; Stochastic processes; Structural engineering; Unsupervised learning;
  • fLanguage
    English
  • Journal_Title
    Automatic Control, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9286
  • Type

    jour

  • DOI
    10.1109/9.85058
  • Filename
    85058