A constrained MDP-based vertical handoff decision algorithm for 4G heterogeneous wireless networks

Authors:
Chi Sun;Enrique Stevens-Navarro;Vahid Shah-Mansouri;Vincent W. Wong
Affiliations:
Department of Electrical and Computer Engineering, The University of British Columbia, Vancouver, Canada V6T 1Z4;Department of Electrical and Computer Engineering, The University of British Columbia, Vancouver, Canada V6T 1Z4;Department of Electrical and Computer Engineering, The University of British Columbia, Vancouver, Canada V6T 1Z4;Department of Electrical and Computer Engineering, The University of British Columbia, Vancouver, Canada V6T 1Z4
Venue:
Wireless Networks
Year:
2011

Citing 9
Cited 1

Markov Decision Processes: Discrete Stochastic Dynamic Programming

Markov Decision Processes: Discrete Stochastic Dynamic Programming
Predictive distance-based mobility management for multidimensional PCS networks

IEEE/ACM Transactions on Networking (TON)
An Adaptive Scheme for Vertical Handoff in Wireless Overlay Networks

ICPADS '04 Proceedings of the Parallel and Distributed Systems, Tenth International Conference
Performance Analysis and Optimization of Handoff Algorithms in Heterogeneous Wireless Networks

IEEE Transactions on Mobile Computing
Dynamic Programming and Optimal Control, Vol. II

Dynamic Programming and Optimal Control, Vol. II
-Learning Algorithms for Constrained Markov Decision Processes With Randomized Monotone Policies: Application to MIMO Transmission Control

IEEE Transactions on Signal Processing
Vertical handoffs in fourth-generation multinetwork environments

IEEE Wireless Communications
Movement-Aware Vertical Handoff of WLAN and Mobile WiMAX for Seamless Ubiquitous Access

IEEE Transactions on Consumer Electronics
Hotspot wireless LANs to enhance the performance of 3G and beyond cellular networks

IEEE Communications Magazine

Immune optimization algorithm for solving vertical handoff decision problem in heterogeneous wireless network

Wireless Networks

Quantified Score

Hi-index	0.00

Visualization

Abstract

The 4th generation wireless communication systems aim to provide users with the convenience of seamless roaming among heterogeneous wireless access networks. To achieve this goal, the support of vertical handoff is important in mobility management. This paper focuses on the vertical handoff decision algorithm, which determines the criteria under which vertical handoff should be performed. The problem is formulated as a constrained Markov decision process. The objective is to maximize the expected total reward of a connection subject to the expected total access cost constraint. In our model, a benefit function is used to assess the quality of the connection, and a penalty function is used to model the signaling incurred and call dropping. The user's velocity and location information are also considered when making handoff decisions. The policy iteration and Q-learning algorithms are employed to determine the optimal policy. Structural results on the optimal vertical handoff policy are derived by using the concept of supermodularity. We show that the optimal policy is a threshold policy in bandwidth, delay, and velocity. Numerical results show that our proposed vertical handoff decision algorithm outperforms other decision schemes in a wide range of conditions such as variations on connection duration, user's velocity, user's budget, traffic type, signaling cost, and monetary access cost.