Title :
Initial experiments on reinforcement learning control of cooperative manipulations
Author :
Svinin, M.M. ; Kojima, F. ; Katada, Y. ; Ueda, K.
Author_Institution :
RIKEN, Inst. of Phys. & Chem. Res., Saitama, Japan
Abstract :
The paper deals with instance-based reinforcement learning control of autonomous robots. A classifier system, defined in the continuous state and action spaces, is outlined. Based on the sensory state space analysis, we define a learning strategy and fix the structure of the action rules. The classifier system features a nonconservative bucket brigade algorithm and a fast reproduction mechanism. The system developed is then applied to learning cooperative behavior by two robots coupled via a common object, with each robot controlled by its own classifier. The feasibility of this scheme is tested under experiment with two Lynxmotion robots, and a motion pattern of cooperative behavior (lifting up an object) is evolved using the two interacting classifier systems
Keywords :
cooperative systems; learning (artificial intelligence); learning systems; motion control; multi-robot systems; Lynxmotion robots; action rules; action spaces; autonomous robots; classifier system; continuous state; cooperative behavior; cooperative manipulations; fast reproduction mechanism; instance-based reinforcement learning control; interacting classifier systems; learning strategy; lifting; nonconservative bucket brigade algorithm; reinforcement learning control; sensory state space analysis; Control systems; Intelligent robots; Intelligent systems; Learning; Motion control; Orbital robotics; Robot control; Robot sensing systems; State-space methods; System testing;
Conference_Titel :
Intelligent Robots and Systems, 2000. (IROS 2000). Proceedings. 2000 IEEE/RSJ International Conference on
Conference_Location :
Takamatsu
Print_ISBN :
0-7803-6348-5
DOI :
10.1109/IROS.2000.894640