Title :
Path planning for mobile robots using an improved reinforcement learning scheme
Author :
Kurozumi, Ryota ; Fujisawa, Shinsuke ; Yamamoto, Toru ; Suita, Yoshikazu
Author_Institution :
Hiroshima Univ., Japan
Abstract :
The current method for establishing travel routes provides modeled environmental information. However, it is difficult to create an environment model for the environments in which mobile robot travel because the environment changes constantly due to the existence of moving objects, Including pedestrians. In this study, we propose a path planning system for mobile robots using reinforcement-learning systems and cerebellar model articulation controllers (CMACs). We selected the best travel route utilizing these reinforcement-learning systems. When a CMAC learns the value function of Q-learning, it improves learning speed by utilizing the generalizing action. CMACs enable us to reduce the time needed to select the best travel route. Using simulation and real robots, we performed a path-planning experiment. We report the results of simulation and experiment on traveling by online learning.
Keywords :
cerebellar model arithmetic computers; learning (artificial intelligence); mobile robots; optimisation; path planning; CMAC; Q-learning; cerebellar model articulation controllers; environmental information; mobile robots; online learning; path planning; pedestrians; reinforcement learning scheme; reinforcement-learning systems; Equations; Gravity; Learning systems; Mobile robots; Orbital robotics; Path planning; Presses;
Conference_Titel :
SICE 2002. Proceedings of the 41st SICE Annual Conference
Print_ISBN :
0-7803-7631-5
DOI :
10.1109/SICE.2002.1195737