Title :
Polynomial cost approximations in Markov decision theory based call admission control
Author :
Rummukainen, Hannu ; Virtamo, Jorma
Author_Institution :
VTT Inf. Technol., Espoo, Finland
fDate :
12/1/2001 12:00:00 AM
Abstract :
The problem of call admission control and routing in a multiservice circuit-switched loss network can be solved optimally under certain assumptions by the tools of Markov decision theory. However, in networks of practical size a number of simplifying approximations are needed to make the solution feasible. Assuming link independence, we propose a new method for approximating the state-dependent link costs accurately and relatively efficiently, even on links with extremely large state spaces. The proposed polynomial approximations are optimal in the sense of minimizing the residual in the continuous-time Howard equations of the Markov decision processes associated with the links. Numerical results are presented, and the proposed approximations are found superior to some earlier link-cost approximation methods
Keywords :
Markov processes; circuit switching; decision theory; optimisation; polynomial approximation; telecommunication congestion control; telecommunication links; telecommunication network routing; Markov decision processes; Markov decision theory; call admission control; continuous-time Howard equations; link independence; link-control policies; link-cost approximation methods; multiservice circuit-switched loss network; network routing; optimal polynomial approximations; polynomial cost approximations; state spaces; state-dependent link costs; Call admission control; Circuits; Costs; Decision theory; Equations; Intelligent networks; Polynomials; Routing; State-space methods; Traffic control;
Journal_Title :
Networking, IEEE/ACM Transactions on