Title :
An approach to tune fuzzy controllers based on reinforcement learning
Author :
Dai, Xiaohui ; Li, C.K. ; Rad, A.B.
Author_Institution :
Dept. of Electron. & Inf. Eng., Hong Kong Polytech. Univ., China
Abstract :
This paper proposes a new approach for the tuning of fuzzy controllers parameters based on reinforcement learning. The architecture of the proposed approach comprises of a Q estimator network (QEN) and a Takagi-Sugeno type fuzzy inference system (FIS). Unlike the most of the existing fuzzy Q-learning approaches, which select an optimal action based on finite discrete actions, while the proposed controller obtain the control output directly. With the proposed architecture, the learning algorithms for all the parameters of the Q estimator network and the FIS are developed based on the temporal difference methods as well as the gradient descent algorithm. The performance of the proposed design technique is illustrated by simulation studies of a vehicle longitudinal control system.
Keywords :
fuzzy control; fuzzy systems; gradient methods; inference mechanisms; learning (artificial intelligence); tuning; Q estimator network; Takagi-Sugeno type fuzzy inference system; fuzzy controllers; gradient descent algorithm; optimal action-value function; parameters tuning; reinforcement learning; temporal difference methods; vehicle longitudinal control system; Adaptive control; Control system synthesis; Control systems; Fuzzy control; Fuzzy systems; Learning; Optimal control; Programmable control; Takagi-Sugeno model; Vehicles;
Conference_Titel :
Fuzzy Systems, 2003. FUZZ '03. The 12th IEEE International Conference on
Print_ISBN :
0-7803-7810-5
DOI :
10.1109/FUZZ.2003.1209417