DocumentCode :
607885
Title :
Implementation of Reinforcement Learning by transfering sub-goal policies in robot navigation
Author :
Gokce, B. ; Akin, H.L.
Author_Institution :
Bilgisayar Muhendisligi Bolumu, Bogazici Univ., Istanbul, Turkey
fYear :
2013
fDate :
24-26 April 2013
Firstpage :
1
Lastpage :
4
Abstract :
Although Reinforcement Learning (RL) is one of the most popular learning methods, it suffers from the curse of dimensionality. If the state and action domains of the problem are immense, the learning rate of the agent decreases dramatically and eventually the agent loses the ability to learn. In order to eliminate the effects of the curse of the dimensionality, researchers typically concentrate on the methods that reduce the complexity of the problems. While some of them model the problem in a hierarchical manner, the others try to transfer the knowledge obtained during the learning process of simpler tasks. While learning from scratch ignores the previous experiences, transferring full knowledge may mislead the agent because of the conflicting requirements. The main goal of this study is to improve the learning rate of the agent by transferring the relevant parts of the knowledge acquired as a result of previous experiences. The main contribution of this study is to merge these two approaches to transfer only the relevant knowledge in a setting. The proposed method is tested on a robot navigation task in a simulated roombased environment.
Keywords :
learning (artificial intelligence); learning systems; navigation; robots; action domain; agent learning rate; knowledge transfer; learning method; learning process; reinforcement learning; robot navigation task; room based environment; state domain; subgoal policy transfer; Computer science; Conferences; Electronic mail; Learning (artificial intelligence); Learning systems; Navigation; Robots; Hierarchical Reinforcement Learning; Reinforcement Learning; Robot Navigation; Transfer Learning;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Signal Processing and Communications Applications Conference (SIU), 2013 21st
Conference_Location :
Haspolat
Print_ISBN :
978-1-4673-5562-9
Electronic_ISBN :
978-1-4673-5561-2
Type :
conf
DOI :
10.1109/SIU.2013.6531546
Filename :
6531546
Link To Document :
بازگشت