A separate-SMDP approximation technique for RRM in heterogeneous wireless networks

This paper proposes the separate-SMDP approximation technique to solve the dimensionality problem of the semi-Markov decision process (SMDP) model for radio resource management (RRM). The proposed separate-SMDP model approximates the original complex SMDP linear programming (LP) problem by building a series of simple SMDP LP problems. The estimated policy results are obtained by solving these LP problems in a distributed manner. Related algorithms are proposed to support the model in actual HWN RRM process. This technique not only greatly decreases the computational complexity of SMDP and solves its dimensionality problem, but also adapts well to actual RRM and provides a new horizon for utilizing SMDP.