• DocumentCode
    2858407
  • Title

    Modular SRV reinforcement learning: an architecture for nonlinear control

  • Author

    Paraskeropoulos, V. ; Heywood, M.I. ; Chatwin, C.R.

  • Author_Institution
    Sussex Univ., Brighton, UK
  • Volume
    3
  • fYear
    1998
  • fDate
    4-9 May 1998
  • Firstpage
    2034
  • Abstract
    Demonstrates the application of a hybrid reinforcement-modular neural network architecture to nonlinear control problems. Specifically, the method of action-critic reinforcement learning, modular neural networks, and winner-takes-all updating are combined. This provides an architecture able to both support temporal difference learning, and probabilistic partitioning of the input space. Furthermore, the number of partitions required a priori of the input space is far lower than that previously in the norm. Application of this methodology to the pole-balancing problem demonstrates superior partitioning of the input space, bettering that of equivalent BP networks; whilst avoiding the learning to learn nothing effect, as is often the case with temporally dependent problems
  • Keywords
    feedforward neural nets; learning (artificial intelligence); neurocontrollers; nonlinear control systems; probability; action-critic reinforcement learning; hybrid reinforcement-modular neural network architecture; modular neural networks; modular stochastic real-valued reinforcement learning; nonlinear control; pole-balancing problem; probabilistic partitioning; temporal difference learning; temporally dependent problems; winner-takes-all updating; Cost function; Function approximation; IEEE members; Jacobian matrices; Learning; Neural networks; Optimization methods; Partitioning algorithms; Predictive models; Stochastic processes;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Neural Networks Proceedings, 1998. IEEE World Congress on Computational Intelligence. The 1998 IEEE International Joint Conference on
  • Conference_Location
    Anchorage, AK
  • ISSN
    1098-7576
  • Print_ISBN
    0-7803-4859-1
  • Type

    conf

  • DOI
    10.1109/IJCNN.1998.687172
  • Filename
    687172