DocumentCode :
425230
Title :
Robot behavioral selection using discrete event language measure
Author :
Wang, Xi ; Fu, Jinbo ; Lee, Peter ; Ray, Asok
Author_Institution :
Dept. of Mech. Eng., Pennsylvania State Univ., University Park, PA, USA
Volume :
6
fYear :
2004
fDate :
June 30 2004-July 2 2004
Firstpage :
5126
Abstract :
This paper proposes a robot behavioral /spl mu/-selection method that maximizes a quantitative measure of languages in the discrete-event setting. This approach complements Q-learning (also called reinforcement learning) that has been widely used in behavioral robotics to learn primitive behaviors. While /spl mu/-selection assigns positive and negative weights to the marked states of a deterministic finite-state automaton (DFSA) model of robot operations, Q-learning assigns reward/penalty on each transition. While the complexity of Q-learning increases exponentially in the number of states and actions, complexity of /spl mu/-selection is polynomial in the number of DFSA states. The paper also presents results of simulation experiments for a robotic scenario to demonstrate the efficacy of the /spl mu/-selection method.
Keywords :
computational complexity; control system synthesis; deterministic automata; discrete event systems; finite state machines; formal languages; learning (artificial intelligence); mobile robots; Q-learning; computational complexity; deterministic finite state automaton model; discrete event language; mobile robot behavioral mu selection method; reinforcement learning;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
American Control Conference, 2004. Proceedings of the 2004
Conference_Location :
Boston, MA, USA
ISSN :
0743-1619
Print_ISBN :
0-7803-8335-4
Type :
conf
Filename :
1384665
Link To Document :
بازگشت