• DocumentCode
    2741113
  • Title

    Mobile agent coordination via a distributed actor-critic algorithm

  • Author

    Paschalidis, Ioannis Ch ; Lin, Yingwei

  • Author_Institution
    Dept. of Electr. & Comput. Eng., Boston Univ., Boston, MA, USA
  • fYear
    2011
  • fDate
    20-23 June 2011
  • Firstpage
    644
  • Lastpage
    649
  • Abstract
    We consider a group of mobile agents operating in a given mission space with obstacles. We formulate a mission as a general reward collection problem where agents collaborate to maximize the total reward collected. The agents decide how they move but face constraints due to the geometry of the mission space, the presence of obstacles, and the need to avoid collisions with other agents. We discretize the mission space and model it as a graph. We then apply the distributed actor-critic method from modified to benefit from least squares temporal difference learning. We present one concrete application: air vehicles flying below a forest´s canopy. Our simulation results demonstrate the efficiency of the policy produced by our algorithm.
  • Keywords
    aircraft; collision avoidance; distributed algorithms; graph theory; learning (artificial intelligence); least squares approximations; mobile agents; air vehicles; collision avoidance; distributed actor-critic method; forest canopy; least square temporal difference learning; mission space; mobile agent coordination; reward collection problem; Aerospace electronics; Convergence; Heuristic algorithms; Markov processes; Sensors; Space missions; Vehicles;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Control & Automation (MED), 2011 19th Mediterranean Conference on
  • Conference_Location
    Corfu
  • Print_ISBN
    978-1-4577-0124-5
  • Type

    conf

  • DOI
    10.1109/MED.2011.5983038
  • Filename
    5983038