DocumentCode :
2318077
Title :
Mobile robot navigation using neural Q-learning
Author :
Yang, Guo-Sheng ; Chen, Er-Kui ; Cheng-Wan An
Author_Institution :
Inst. of Comput. & Inf. Eng., Henan Univ., Kaifeng, China
Volume :
1
fYear :
2004
fDate :
26-29 Aug. 2004
Firstpage :
48
Abstract :
Continuous Q-learning algorithm has been widely used in robotic domains for its simplicity and well-developed theory. In this paper mobile robot navigation using neural Q-learning is processed. Firstly, according to our developed mobile robot CASIA-I and its working environment, an approach is proposed, used to determine the reward/penalty function of Q-learning. Secondly, after analysis of the continuous Q-learning algorithm based on the multi-layer feedforward neural network, a method for computing the weights of the hidden and output layers is given, and mobile robot navigation using neural Q-learning is implemented. At last, experimental results are included to show that the action policy obtained through Q-learning can make the mobile robot reach the destination without obstacle collision.
Keywords :
collision avoidance; feedforward neural nets; learning (artificial intelligence); mobile robots; navigation; neurocontrollers; mobile robot navigation; multilayer feedforward neural network; neural Q-learning; Feedforward neural networks; Infrared sensors; Mobile robots; Multi-layer neural network; Navigation; Neural networks; Robot sensing systems; Robotics and automation; Tactile sensors; Ultrasonic variables measurement;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Machine Learning and Cybernetics, 2004. Proceedings of 2004 International Conference on
Print_ISBN :
0-7803-8403-2
Type :
conf
DOI :
10.1109/ICMLC.2004.1380601
Filename :
1380601
Link To Document :
بازگشت