A New Value Iteration method for the Average Cost Dynamic Programming Problem
SIAM Journal on Control and Optimization
Markov Decision Processes: Discrete Stochastic Dynamic Programming
Markov Decision Processes: Discrete Stochastic Dynamic Programming
Game Theory and Decision Theory in Agent-Based Systems
Game Theory and Decision Theory in Agent-Based Systems
Privacy and Anonymity in Personal Networks
PERCOMW '05 Proceedings of the Third IEEE International Conference on Pervasive Computing and Communications Workshops
A Vertical Handover Decision Algorithm Based on Fuzzy Control Theory
IMSCCS '06 Proceedings of the First International Multi-Symposiums on Computer and Computational Sciences - Volume 2 (IMSCCS'06) - Volume 02
Design and implementation of a context-aware decision algorithm for heterogeneous networks
Proceedings of the 2006 ACM symposium on Applied computing
Adaptive Vertical Mobility Decision in Heterogeneous Networks
ICWMC '07 Proceedings of the Third International Conference on Wireless and Mobile Communications
| Hi-index | 0.24 |
In this paper, we investigate Decision Theory (DT) and Markov Decision Process (MDP) based approaches for vertical handover decision making in in-home networks. Here, we consider a heterogeneous network environment with both legacy WLAN and novel line-of-sight (LOS)-dependent 60GHz radio systems deployed in home to support high quality multimedia applications. Both the above decision-making approaches take into account multiple subjective and objective factors, such as user preference, network condition, device capability and impact of the environment. We make decisions based on an evaluation of the candidate actions, but with different length of horizon. We show their ability to effectively make decisions, to handover or not, in uncertain situations. The method and results herein are in general applicable to any other situation where such a decision has to be made.