Title :
Modular SRV reinforcement learning: an architecture for nonlinear control
Author :
Paraskeropoulos, V. ; Heywood, M.I. ; Chatwin, C.R.
Author_Institution :
Sussex Univ., Brighton, UK
Abstract :
Demonstrates the application of a hybrid reinforcement-modular neural network architecture to nonlinear control problems. Specifically, the method of action-critic reinforcement learning, modular neural networks, and winner-takes-all updating are combined. This provides an architecture able to both support temporal difference learning, and probabilistic partitioning of the input space. Furthermore, the number of partitions required a priori of the input space is far lower than that previously in the norm. Application of this methodology to the pole-balancing problem demonstrates superior partitioning of the input space, bettering that of equivalent BP networks; whilst avoiding the learning to learn nothing effect, as is often the case with temporally dependent problems
Keywords :
feedforward neural nets; learning (artificial intelligence); neurocontrollers; nonlinear control systems; probability; action-critic reinforcement learning; hybrid reinforcement-modular neural network architecture; modular neural networks; modular stochastic real-valued reinforcement learning; nonlinear control; pole-balancing problem; probabilistic partitioning; temporal difference learning; temporally dependent problems; winner-takes-all updating; Cost function; Function approximation; IEEE members; Jacobian matrices; Learning; Neural networks; Optimization methods; Partitioning algorithms; Predictive models; Stochastic processes;
Conference_Titel :
Neural Networks Proceedings, 1998. IEEE World Congress on Computational Intelligence. The 1998 IEEE International Joint Conference on
Conference_Location :
Anchorage, AK
Print_ISBN :
0-7803-4859-1
DOI :
10.1109/IJCNN.1998.687172