Adaptive call admission control under quality of service constraints: a reinforcement learning solution

Authors:
Hui Tong;T. X. Brown
Affiliations:
Dept. of Electr. & Comput. Eng., Colorado Univ., Boulder, CO;-
Venue:
IEEE Journal on Selected Areas in Communications
Year:
2006

Citing 0
Cited 14

Reinforcement Learning for Call Admission Control and Routing under Quality of Service Constraints in Multimedia Networks

Machine Learning
Minimizing Transmission Costs through Adaptive Marking in Differentiated Services Networks

MMNS '02 Proceedings of the 5th IFIP/IEEE International Conference on Management of Multimedia Networks and Services: Management of Multimedia on the Internet
Reinforcement Learning for Control of Traffic and Access Points in Intelligent Wireless ATM Networks

Proceedings of the International Conference, 7th Fuzzy Days on Computational Intelligence, Theory and Applications
Call Admission Control for Multimedia Cellular Networks Using Neuro-dynamic Programming

NETWORKING '02 Proceedings of the Second International IFIP-TC6 Networking Conference on Networking Technologies, Services, and Protocols; Performance of Computer and Communication Networks; and Mobile and Wireless Communications
Call admission control in cellular networks: a reinforcement learning solution

International Journal of Network Management
Efficient QoS Provisioning for Adaptive Multimedia in Mobile Communication Networks by Reinforcement Learning

BROADNETS '04 Proceedings of the First International Conference on Broadband Networks
Efficient QoS provisioning for adaptive multimedia in mobile communication networks by reinforcement learning

Mobile Networks and Applications - Special issue: Recent advances in wireless networking
Assured end-to-end QoS through adaptive marking in multi-domain differentiated services networks

Computer Communications
Reinforcement learning-based dynamic bandwidth provisioning for quality of service in differentiated services networks

Computer Communications
Cross-layer QoS provisioning for multimedia transmissions in cognitive radio networks

WCNC'09 Proceedings of the 2009 IEEE conference on Wireless Communications & Networking Conference
A reinforcement learning-based lightpath establishment for service differentiation in all-optical WDM networks

GLOBECOM'09 Proceedings of the 28th IEEE conference on Global telecommunications
Online learning in autonomic multi-hop wireless networks for transmitting mission-critical applications

IEEE Journal on Selected Areas in Communications
Application layer QoS optimization for multimedia transmission over cognitive radio networks

Wireless Networks
A general framework for analyzing the optimal call admission control in DS-CDMA cellular network

ICCSA'05 Proceedings of the 2005 international conference on Computational Science and Its Applications - Volume Part II

Quantified Score

Hi-index	0.07

Visualization

Abstract

We solve the adaptive call admission control (CAC) problem in multimedia networks via reinforcement learning (RL). The problem requires that network revenue be maximized while simultaneously meeting quality of service (QoS) constraints that forbid entry into certain states and use of certain actions. We show that RL provides a solution to this constrained semi-Markov decision problem and is able to earn significantly higher revenues than alternative heuristics. Unlike other model-based algorithms, RL does not require the explicit state transition models to solve the decision problems. This feature is very important if one considers large integrated service networks supporting a number of different service types, where the number of states is so large that model-based optimization algorithms are infeasible. Both packet-level and call-level QoS constraints are addressed, and both conservative and aggressive approaches to the QoS constraints are considered. Results are demonstrated on a single link and extended to routing on a multilink network