A game theoretic framework for bandwidth allocation and pricing in broadband networks
IEEE/ACM Transactions on Networking (TON)
Hidden Markov modeling for network communication channels
Proceedings of the 2001 ACM SIGMETRICS international conference on Measurement and modeling of computer systems
Dynamic Programming and Optimal Control, Two Volume Set
Dynamic Programming and Optimal Control, Two Volume Set
A Markov-based channel model algorithm for wireless networks
Wireless Networks
A globally stable adaptive congestion control scheme for internet-style networks with delay
IEEE/ACM Transactions on Networking (TON)
Simulative Analysis of Access Selection Algorithms for Multi-Access Networks
WOWMOM '06 Proceedings of the 2006 International Symposium on on World of Wireless, Mobile and Multimedia Networks
Rate allocation for multi-user video streaming over heterogenous access networks
Proceedings of the 15th international conference on Multimedia
Proceedings of the 2007 Workshop on Middleware for next-generation converged networks and applications
Globally optimal user-network association in an 802.11 WLAN & 3G UMTS hybrid cell
ITC20'07 Proceedings of the 20th international teletraffic conference on Managing traffic performance in converged networks
Multiservice allocation for multiaccess wireless systems
IEEE Transactions on Wireless Communications
The IMS service platform: a solution for next-generation network operators to be more than bit pipes
IEEE Communications Magazine
Analysis of video transmission over lossy channels
IEEE Journal on Selected Areas in Communications
Autonomic system for mobility support in 4G networks
IEEE Journal on Selected Areas in Communications
Dynamic resource modeling for heterogeneous wireless networks
ICC'09 Proceedings of the 2009 IEEE international conference on Communications
Quantitative access control with partially-observable Markov decision processes
Proceedings of the second ACM conference on Data and Application Security and Privacy
Hi-index | 0.00 |
We consider a scenario where devices with multiple networking capabilities access networks with heterogeneous characteristics. In such a setting, we address the problem of efficient utilization of multiple access networks by devices via optimal assignment of traffic flows with given utilities to different networks. We develop and analyze a device middleware functionality that monitors network characteristics and employs a Markov Decision Process (MDP) based control scheme that in conjunction with stochastic characterization of the available bit rate and delay of the networks generates an optimal policy for allocation of flows to different networks. The optimal policy maximizes, under available bit rate and delay constraints on the access networks, a discounted reward which is a function of the flow utilities. The flow assignment policy is periodically updated and is consulted by the flows to dynamically perform network selection during their lifetimes. We perform measurement tests to collect traces of available bit rate and delay characteristics on Ethernet and WLAN networks on a work day in a corporate work environment. We implement our flow assignment framework in ns-2 and simulate the system performance for a set of elastic video-like flows using the collected traces. We demonstrate that the MDP based flow assignment policy leads to significant enhancement in the QoS provisioning (higher rate allocation, lower packet delays and packet loss rates) for the flows and better access network utilization, as compared to policies that allocate flows to different networks using greedy approaches or heuristics like average available bit rate on the networks.