• DocumentCode
    2318077
  • Title

    Mobile robot navigation using neural Q-learning

  • Author

    Yang, Guo-Sheng ; Chen, Er-Kui ; Cheng-Wan An

  • Author_Institution
    Inst. of Comput. & Inf. Eng., Henan Univ., Kaifeng, China
  • Volume
    1
  • fYear
    2004
  • fDate
    26-29 Aug. 2004
  • Firstpage
    48
  • Abstract
    Continuous Q-learning algorithm has been widely used in robotic domains for its simplicity and well-developed theory. In this paper mobile robot navigation using neural Q-learning is processed. Firstly, according to our developed mobile robot CASIA-I and its working environment, an approach is proposed, used to determine the reward/penalty function of Q-learning. Secondly, after analysis of the continuous Q-learning algorithm based on the multi-layer feedforward neural network, a method for computing the weights of the hidden and output layers is given, and mobile robot navigation using neural Q-learning is implemented. At last, experimental results are included to show that the action policy obtained through Q-learning can make the mobile robot reach the destination without obstacle collision.
  • Keywords
    collision avoidance; feedforward neural nets; learning (artificial intelligence); mobile robots; navigation; neurocontrollers; mobile robot navigation; multilayer feedforward neural network; neural Q-learning; Feedforward neural networks; Infrared sensors; Mobile robots; Multi-layer neural network; Navigation; Neural networks; Robot sensing systems; Robotics and automation; Tactile sensors; Ultrasonic variables measurement;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Machine Learning and Cybernetics, 2004. Proceedings of 2004 International Conference on
  • Print_ISBN
    0-7803-8403-2
  • Type

    conf

  • DOI
    10.1109/ICMLC.2004.1380601
  • Filename
    1380601