Markov Decision Process-Based Adaptive Vertical Handoff with RSS Prediction in Heterogeneous Wireless Networks

In a heterogeneous wireless network (HWN) that consists of various wireless networks (e.g., WiMAX and WiFi) and cellular communications (e.g., B3G and 4G), vertical handoff acts as an important mechanism for achieving continuous seamless transmissions and improving grade of service. This work thus proposes an adaptive vertical handoff algorithm with predictive RSS to reduce unnecessary handoff while increasing utilization and decreasing connection dropping significantly. The proposed approach determines the optimal target network in two phases: polynomial regression RSS prediction and Markov decision process analysis. Numerical results indicate that the proposed adaptive approach outperforms other approaches in the number of vertical handoffs and SWGoS while yielding competitive utilization.