DocumentCode
2318077
Title
Mobile robot navigation using neural Q-learning
Author
Yang, Guo-Sheng ; Chen, Er-Kui ; Cheng-Wan An
Author_Institution
Inst. of Comput. & Inf. Eng., Henan Univ., Kaifeng, China
Volume
1
fYear
2004
fDate
26-29 Aug. 2004
Firstpage
48
Abstract
Continuous Q-learning algorithm has been widely used in robotic domains for its simplicity and well-developed theory. In this paper mobile robot navigation using neural Q-learning is processed. Firstly, according to our developed mobile robot CASIA-I and its working environment, an approach is proposed, used to determine the reward/penalty function of Q-learning. Secondly, after analysis of the continuous Q-learning algorithm based on the multi-layer feedforward neural network, a method for computing the weights of the hidden and output layers is given, and mobile robot navigation using neural Q-learning is implemented. At last, experimental results are included to show that the action policy obtained through Q-learning can make the mobile robot reach the destination without obstacle collision.
Keywords
collision avoidance; feedforward neural nets; learning (artificial intelligence); mobile robots; navigation; neurocontrollers; mobile robot navigation; multilayer feedforward neural network; neural Q-learning; Feedforward neural networks; Infrared sensors; Mobile robots; Multi-layer neural network; Navigation; Neural networks; Robot sensing systems; Robotics and automation; Tactile sensors; Ultrasonic variables measurement;
fLanguage
English
Publisher
ieee
Conference_Titel
Machine Learning and Cybernetics, 2004. Proceedings of 2004 International Conference on
Print_ISBN
0-7803-8403-2
Type
conf
DOI
10.1109/ICMLC.2004.1380601
Filename
1380601
Link To Document