Title :
Robot behavioral selection using discrete event language measure
Author :
Wang, Xi ; Fu, Jinbo ; Lee, Peter ; Ray, Asok
Author_Institution :
Dept. of Mech. Eng., Pennsylvania State Univ., University Park, PA, USA
fDate :
June 30 2004-July 2 2004
Abstract :
This paper proposes a robot behavioral /spl mu/-selection method that maximizes a quantitative measure of languages in the discrete-event setting. This approach complements Q-learning (also called reinforcement learning) that has been widely used in behavioral robotics to learn primitive behaviors. While /spl mu/-selection assigns positive and negative weights to the marked states of a deterministic finite-state automaton (DFSA) model of robot operations, Q-learning assigns reward/penalty on each transition. While the complexity of Q-learning increases exponentially in the number of states and actions, complexity of /spl mu/-selection is polynomial in the number of DFSA states. The paper also presents results of simulation experiments for a robotic scenario to demonstrate the efficacy of the /spl mu/-selection method.
Keywords :
computational complexity; control system synthesis; deterministic automata; discrete event systems; finite state machines; formal languages; learning (artificial intelligence); mobile robots; Q-learning; computational complexity; deterministic finite state automaton model; discrete event language; mobile robot behavioral mu selection method; reinforcement learning;
Conference_Titel :
American Control Conference, 2004. Proceedings of the 2004
Conference_Location :
Boston, MA, USA
Print_ISBN :
0-7803-8335-4