Title :
A Pursuit-Evasion Algorithm Based on Hierarchical Reinforcement Learning
Author :
Liu, Jie ; Liu, Shuhua ; Wu, Hongyan ; Zhang, Yu
Author_Institution :
Comput. Sci. Sch., Northeast Normal Univ., Changchun, China
Abstract :
This paper proposed a pursuit-evasion algorithm based on the Option method from hierarchical reinforcement learning and applied it into multi-robot pursuit-evasion game in 2D-Dynamic environment. The algorithm efficiency is studied by comparing it with Q-learning. We decompose the complex task with option method, and divide the learning process into two parts: High-level learning and Low-level learning, then design a new mechanism in order to make the learning process perform parallel. The simulation result shows the Option algorithm can efficiently reduce the complexity of pursuit-evasion task, avoid traditional reinforcement learning curse of dimensionality, and improve the learning result.
Keywords :
game theory; intelligent robots; learning (artificial intelligence); multi-robot systems; 2D-dynamic environment; Q-learning; hierarchical reinforcement learning; high-level learning; low-level learning; multirobot pursuit-evasion game; option method; Automation; Collaboration; Computational geometry; Computer science; Dynamic programming; Genetic programming; Learning; Mechatronics; Paper technology; Pursuit algorithms; Pursuit Evasion Problem; Reinforcement Learning;
Conference_Titel :
Measuring Technology and Mechatronics Automation, 2009. ICMTMA '09. International Conference on
Conference_Location :
Zhangjiajie, Hunan
Print_ISBN :
978-0-7695-3583-8
DOI :
10.1109/ICMTMA.2009.213