Title :
A multi-agent adaptive traffic signal control system using swarm intelligence and neuro-fuzzy reinforcement learning
Author :
Lu, Wei ; Zhang, Yunlong ; Xie, Yuanchang
Author_Institution :
Zachry Dept. of Civil Eng., Texas A&M Univ., College Station, TX, USA
fDate :
June 29 2011-July 1 2011
Abstract :
This research develops and evaluates a new multi-agent adaptive traffic signal control system based on swarm intelligence and the neural-fuzzy actor-critic reinforcement learning (NFACRL) method. The proposed method combines the better attributes of swarm intelligence and the NFACRL method. Two scenarios are used to evaluate the method and the new NFACRL-Swarm method is compared with its NFACRL counterpart. First, the proposed control model is applied to isolated intersection signal adaptive control to evaluate its learning performance. Then, the control system is implemented in signal control coordination in a typical arterial. In the isolated intersection, the proposed hybrid method outperforms its previous counterpart by improving the learning speed and is shown to be insensitive to reward function parameters. In the network, by introducing a coordination scheme inspired by swarm intelligence, the proposed method improves the performance by up to 12% and has a faster learning speed.
Keywords :
adaptive control; fuzzy neural nets; learning (artificial intelligence); multi-agent systems; traffic control; control system; isolated intersection signal adaptive control; multiagent adaptive traffic signal control system; neural-fuzzy actor-critic reinforcement learning; swarm intelligence; Adaptation models; Delay; Learning; Optimization; Particle swarm optimization; Training; Vehicles;
Conference_Titel :
Integrated and Sustainable Transportation System (FISTS), 2011 IEEE Forum on
Conference_Location :
Vienna
Print_ISBN :
978-1-4577-0990-6
Electronic_ISBN :
978-1-4577-0991-3
DOI :
10.1109/FISTS.2011.5973658