Title :
Communication Decision in Decentralized Control of Coordinated System
Author :
Liu, Haitao ; Qiao, Limin ; Hong, Bingrong ; Piao, Songhao
Author_Institution :
Harbin Inst. of Technol., Harbin
Abstract :
Although instantaneous and free communication simplifies multi-agent partially observable Markov decision processes (POMDPs) to single-agent POMDPs, in practice, communication is not free and reducing the amount of communication is often desirable. We present a novel approach for using a DAG to maintain and reason the possible joint beliefs of the team at the less cost of memory, by which communication decisions are made in a decentralized style. Our algorithm, called DAG-DEC-COMM, makes a tradeoff between the performance achieved by the team and the amount of communication used in planning. The experimental results on the benchmark problem show that our approach drastically reduces the communication with a significant decrease in storing the possible joint beliefs while improving the performance of distributed execution.
Keywords :
Markov processes; decentralised control; multi-robot systems; benchmark problem; communication decision; coordinated system; decentralized control; partially observable Markov decision processes; Automation; Computer science; Costs; Distributed control; Dynamic programming; Heuristic algorithms; Mechatronics; Multiagent systems; Teamwork; Communication; decentralized POMDP; directed acyclic graph; distributed execution;
Conference_Titel :
Mechatronics and Automation, 2007. ICMA 2007. International Conference on
Conference_Location :
Harbin
Print_ISBN :
978-1-4244-0828-3
Electronic_ISBN :
978-1-4244-0828-3
DOI :
10.1109/ICMA.2007.4304007