Title :
Mobile robot navigation using neural Q-learning
Author :
Yang, Guo-Sheng ; Chen, Er-Kui ; Cheng-Wan An
Author_Institution :
Inst. of Comput. & Inf. Eng., Henan Univ., Kaifeng, China
Abstract :
Continuous Q-learning algorithm has been widely used in robotic domains for its simplicity and well-developed theory. In this paper mobile robot navigation using neural Q-learning is processed. Firstly, according to our developed mobile robot CASIA-I and its working environment, an approach is proposed, used to determine the reward/penalty function of Q-learning. Secondly, after analysis of the continuous Q-learning algorithm based on the multi-layer feedforward neural network, a method for computing the weights of the hidden and output layers is given, and mobile robot navigation using neural Q-learning is implemented. At last, experimental results are included to show that the action policy obtained through Q-learning can make the mobile robot reach the destination without obstacle collision.
Keywords :
collision avoidance; feedforward neural nets; learning (artificial intelligence); mobile robots; navigation; neurocontrollers; mobile robot navigation; multilayer feedforward neural network; neural Q-learning; Feedforward neural networks; Infrared sensors; Mobile robots; Multi-layer neural network; Navigation; Neural networks; Robot sensing systems; Robotics and automation; Tactile sensors; Ultrasonic variables measurement;
Conference_Titel :
Machine Learning and Cybernetics, 2004. Proceedings of 2004 International Conference on
Print_ISBN :
0-7803-8403-2
DOI :
10.1109/ICMLC.2004.1380601