DocumentCode
2858407
Title
Modular SRV reinforcement learning: an architecture for nonlinear control
Author
Paraskeropoulos, V. ; Heywood, M.I. ; Chatwin, C.R.
Author_Institution
Sussex Univ., Brighton, UK
Volume
3
fYear
1998
fDate
4-9 May 1998
Firstpage
2034
Abstract
Demonstrates the application of a hybrid reinforcement-modular neural network architecture to nonlinear control problems. Specifically, the method of action-critic reinforcement learning, modular neural networks, and winner-takes-all updating are combined. This provides an architecture able to both support temporal difference learning, and probabilistic partitioning of the input space. Furthermore, the number of partitions required a priori of the input space is far lower than that previously in the norm. Application of this methodology to the pole-balancing problem demonstrates superior partitioning of the input space, bettering that of equivalent BP networks; whilst avoiding the learning to learn nothing effect, as is often the case with temporally dependent problems
Keywords
feedforward neural nets; learning (artificial intelligence); neurocontrollers; nonlinear control systems; probability; action-critic reinforcement learning; hybrid reinforcement-modular neural network architecture; modular neural networks; modular stochastic real-valued reinforcement learning; nonlinear control; pole-balancing problem; probabilistic partitioning; temporal difference learning; temporally dependent problems; winner-takes-all updating; Cost function; Function approximation; IEEE members; Jacobian matrices; Learning; Neural networks; Optimization methods; Partitioning algorithms; Predictive models; Stochastic processes;
fLanguage
English
Publisher
ieee
Conference_Titel
Neural Networks Proceedings, 1998. IEEE World Congress on Computational Intelligence. The 1998 IEEE International Joint Conference on
Conference_Location
Anchorage, AK
ISSN
1098-7576
Print_ISBN
0-7803-4859-1
Type
conf
DOI
10.1109/IJCNN.1998.687172
Filename
687172
Link To Document