Adaptive provisioning of differentiated services networks based on reinforcement learning

Authors:
T. C.-K. Hui;Chen-Khong Tham
Affiliations:
Dept. of Electr. & Comput. Eng., Nat. Univ. of Singapore, Singapore;-
Venue:
IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews
Year:
2003

Citing 0
Cited 9

A framework for admission control and path allocation in DiffServ networks

Computer Networks: The International Journal of Computer and Telecommunications Networking
A pricing approach for bandwidth allocation in differentiated service networks

Computers and Operations Research
Fuzzy neural control for economic-driven radio resource management in beyond 3G networks

IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews
An application of reinforcement learning for efficient spectrum usage in next-generation mobile cellular networks

IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews
Dynamic bandwidth provisioning using ARIMA-based traffic forecasting for Mobile WiMAX

Computer Communications
Knowledge discovery using Bayesian network framework for intelligent telecommunication network management

KSEM'10 Proceedings of the 4th international conference on Knowledge science, engineering and management
A dynamic qos management scheme in b3g networks

ICCSA'06 Proceedings of the 2006 international conference on Computational Science and Its Applications - Volume Part II
Supporting differentiated service in mobile ad hoc networks through congestion control

ICOIN'05 Proceedings of the 2005 international conference on Information Networking: convergence in broadband and mobile networking
A congestion control scheme for supporting differentiated service in mobile ad hoc networks

ICN'05 Proceedings of the 4th international conference on Networking - Volume Part I

Quantified Score

Hi-index	0.00

Visualization

Abstract

The issue of bandwidth provisioning for Per Hop Behavior (PHB) aggregates in Differentiated Services (DiffServ) networks has received a lot of attention from researchers. However, most proposed methods need to determine the amount of bandwidth to provision at the time of connection admission. This assumes that traffic in admitted flows always conforms to predefined specifications, which would need some form of traffic shaping or admission control before reaching the ingress of the domain. This paper proposes an adaptive provisioning mechanism based on reinforcement-learning principles, which determines at regular intervals the amount of bandwidth to provision to each PHB aggregate. The mechanism adjusts to maximize the amount of revenue earned from a usage-based pricing model. The novel use of a continuous-space, gradient-based learning algorithm, enables the mechanism to require neither accurate traffic specifications nor rigid admission control. Using ns-2 simulations, we demonstrate using Weighted Fair Queuing, how our mechanism can be implemented in a DiffServ network.