Title :
Simulated annealing-reinforcement learning algorithm for ABR traffic control of ATM networks
Author :
Li, Xin ; Shen, Xiaojun ; Jing, Yuanwei ; Zhang, Siying
Author_Institution :
Northeastern Univ., Shenyang
Abstract :
For the congestion problems in asynchronous transfer mode (ATM) networks, a hybrid intelligent controller based on simulated annealing (SA) and reinforcement learning (RL) algorithm is proposed. The SA algorithm is a powerful way to solve hard combinatorial optimization problems, which is used to adjust the parameters of the controller. The RL algorithm shows the particular superiority in ATM networks, which is independent of the mathematic model and just needs simple fuzzy information obtained through trial-and-error and interaction with the environment. With the advantages of the two algorithms, the proposed controller forces the queue size in the multiplexer buffer to the desired value by adjusting the source transmission rate of the available bit rate (ABR) service. Simulation results show that the proposed method can promote the performance of the networks and avoid the occurrence of congestion effectively.
Keywords :
asynchronous transfer mode; combinatorial mathematics; fuzzy control; intelligent control; learning (artificial intelligence); queueing theory; simulated annealing; telecommunication congestion control; telecommunication traffic; asynchronous transfer mode networks; available bit rate traffic control; combinatorial optimization problems; hybrid intelligent controller; mathematic model; multiplexer buffer; queue size; simulated annealing; simulated annealing-reinforcement learning algorithm; source transmission rate; trial-and-error; Asynchronous transfer mode; Force control; Intelligent networks; Learning; Mathematical model; Mathematics; Multiplexing; Simulated annealing; Size control; Traffic control;
Conference_Titel :
Decision and Control, 2007 46th IEEE Conference on
Conference_Location :
New Orleans, LA
Print_ISBN :
978-1-4244-1497-0
Electronic_ISBN :
0191-2216
DOI :
10.1109/CDC.2007.4434121