• DocumentCode
    137758
  • Title

    Optimal and dynamic planning for Markov decision processes with co-safe LTL specifications

  • Author

    Lacerda, Bruno ; Parker, Dennis ; Hawes, Nick

  • Author_Institution
    Sch. of Comput. Sci., Univ. of Birmingham, Birmingham, UK
  • fYear
    2014
  • fDate
    14-18 Sept. 2014
  • Firstpage
    1511
  • Lastpage
    1516
  • Abstract
    We present a method to specify tasks and synthesise cost-optimal policies for Markov decision processes using co-safe linear temporal logic. Our approach incorporates a dynamic task handling procedure which allows for the addition of new tasks during execution and provides the ability to re-plan an optimal policy on-the-fly. This new policy minimises the cost to satisfy the conjunction of the current tasks and the new one, taking into account how much of the current tasks has already been executed. We illustrate our approach by applying it to motion planning for a mobile service robot.
  • Keywords
    Markov processes; decision making; mobile robots; path planning; service robots; temporal logic; Markov decision processes; cosafe LTL specifications; cosafe linear temporal logic; cost-optimal policies; dynamic planning; dynamic task handling procedure; mobile service robot; motion planning; optimal planning; Cost function; Markov processes; Navigation; Planning; Probabilistic logic; Robot kinematics;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Intelligent Robots and Systems (IROS 2014), 2014 IEEE/RSJ International Conference on
  • Conference_Location
    Chicago, IL
  • Type

    conf

  • DOI
    10.1109/IROS.2014.6942756
  • Filename
    6942756