Title :
Fuzzy reinforcement learning and its application in robot navigation
Author :
Duan, Yong ; Xin-Hexu
Author_Institution :
Inst. of Artificial Intelligence & Robotics, Northeastern Univ., Shenyang, China
Abstract :
This paper focused on the problem of the intelligent mobile robot navigation under the unknown and changing environment. The fuzzy logic controller (FLC) is applied to the reactive robot control system. Without sufficient expert knowledge can be available, the fuzzy inference system (FIS) and reinforcement learning (RL) are integrated. The consequence of fuzzy rules is refined through Q (λ)-learning. Then, the fuzzy reinforcement learning is employed to design controller of the robot system. The scheme of switching behavior-based FLC was presented, which includes avoidance obstacles behavior and wall-following behavior. This scheme can effectively solve the problem of navigation under complicated environment, which contains the concave obstacles. Experiment results indicate that efficiency and effectiveness of the proposed approach. Furthermore, the FLC learned by RL has robust and adaptability, and can be applied to the different environments.
Keywords :
fuzzy control; fuzzy logic; fuzzy systems; inference mechanisms; learning (artificial intelligence); mobile robots; fuzzy inference system; fuzzy logic controller; fuzzy reinforcement learning; intelligent mobile robot navigation; reactive robot control system; Control systems; Fuzzy control; Fuzzy logic; Fuzzy systems; Intelligent robots; Learning; Mobile robots; Navigation; Robot control; Robustness; Fuzzy logic controller; Q(λ)-learning; Reinforcement learning; Robot navigation;
Conference_Titel :
Machine Learning and Cybernetics, 2005. Proceedings of 2005 International Conference on
Conference_Location :
Guangzhou, China
Print_ISBN :
0-7803-9091-1
DOI :
10.1109/ICMLC.2005.1527071