DocumentCode :
3644773
Title :
Exploiting previous experience to constrain robot sensorimotor learning
Author :
Bojan Nemec;Rok Vuga;Aleš Ude
Author_Institution :
Jož
fYear :
2011
Firstpage :
727
Lastpage :
732
Abstract :
A truly autonomous robot should be able to generalize known actions to new situations and to autonomously refine its knowledge base. In this paper we present a three stage approach to the problem of expanding and refining the database of sensorimotor knowledge. The first stage is based on the generalization of previously trained movements associated with a specific task, which results in a first approximation of a suitable control policy in a new situation. The second stage applies learning on the manifold defined by the previously acquired training data, which results in a learning problem of reduced dimensionality. The final tuning of the desired control policy is accomplished by learning in the full state space, where the dimensionality of the problem is much higher. The assumption is that the first two steps already provide a good initial estimate for the optimal control policy so that this final step only locally refines the parameters learned in the first two steps. This significantly reduces the number of test trials needed by standard reinforcement learning techniques. The proposed approach was evaluated in simulation as well as on the real robot in a ball throwing experiment.
Keywords :
"Trajectory","Robots","Manifolds","Training","Estimation","Learning","Gradient methods"
Publisher :
ieee
Conference_Titel :
Humanoid Robots (Humanoids), 2011 11th IEEE-RAS International Conference on
ISSN :
2164-0572
Print_ISBN :
978-1-61284-866-2
Electronic_ISBN :
2164-0580
Type :
conf
DOI :
10.1109/Humanoids.2011.6100913
Filename :
6100913
Link To Document :
بازگشت