DocumentCode
2741113
Title
Mobile agent coordination via a distributed actor-critic algorithm
Author
Paschalidis, Ioannis Ch ; Lin, Yingwei
Author_Institution
Dept. of Electr. & Comput. Eng., Boston Univ., Boston, MA, USA
fYear
2011
fDate
20-23 June 2011
Firstpage
644
Lastpage
649
Abstract
We consider a group of mobile agents operating in a given mission space with obstacles. We formulate a mission as a general reward collection problem where agents collaborate to maximize the total reward collected. The agents decide how they move but face constraints due to the geometry of the mission space, the presence of obstacles, and the need to avoid collisions with other agents. We discretize the mission space and model it as a graph. We then apply the distributed actor-critic method from modified to benefit from least squares temporal difference learning. We present one concrete application: air vehicles flying below a forest´s canopy. Our simulation results demonstrate the efficiency of the policy produced by our algorithm.
Keywords
aircraft; collision avoidance; distributed algorithms; graph theory; learning (artificial intelligence); least squares approximations; mobile agents; air vehicles; collision avoidance; distributed actor-critic method; forest canopy; least square temporal difference learning; mission space; mobile agent coordination; reward collection problem; Aerospace electronics; Convergence; Heuristic algorithms; Markov processes; Sensors; Space missions; Vehicles;
fLanguage
English
Publisher
ieee
Conference_Titel
Control & Automation (MED), 2011 19th Mediterranean Conference on
Conference_Location
Corfu
Print_ISBN
978-1-4577-0124-5
Type
conf
DOI
10.1109/MED.2011.5983038
Filename
5983038
Link To Document