Assured end-to-end QoS through adaptive marking in multi-domain differentiated services networks

Authors:
Chen-Khong Tham;Yong Liu
Affiliations:
Department of Electrical and Computer Engineering, National University of Singapore, Singapore 119260;Department of Electrical and Computer Engineering, National University of Singapore, Singapore 119260
Venue:
Computer Communications
Year:
2005

Citing 10
Cited 2

Technical Note: \cal Q-Learning

Machine Learning
Adaptive packet marking for maintaining end-to-end throughput in a differentiated-services internet

IEEE/ACM Transactions on Networking (TON)
Neuro-Dynamic Programming

Neuro-Dynamic Programming
Learning to Predict by the Methods of Temporal Differences

Machine Learning
Minimizing Transmission Costs through Adaptive Marking in Differentiated Services Networks

MMNS '02 Proceedings of the 5th IFIP/IEEE International Conference on Management of Multimedia Networks and Services: Management of Multimedia on the Internet
Implementation of a bandwidth broker for dynamic end-to-end resource reservation in outsourced virtual private networks

LCN '00 Proceedings of the 25th Annual IEEE Conference on Local Computer Networks
Call admission control and routing in integrated services networks using neuro-dynamic programming

IEEE Journal on Selected Areas in Communications
Adaptive call admission control under quality of service constraints: a reinforcement learning solution

IEEE Journal on Selected Areas in Communications
A random early demotion and promotion marker for assured services

IEEE Journal on Selected Areas in Communications
A dynamic channel assignment policy through Q-learning

IEEE Transactions on Neural Networks

SLA-based complementary approach for network intrusion detection

Computer Communications
Service Violation Monitoring Model for Detecting and Tracing Bandwidth Abuse

Journal of Network and Systems Management

Quantified Score

Hi-index	0.24

Visualization

Abstract

The issue of resource management in multi-domain Differentiated Services (DiffServ) networks has attracted a lot of attention from researchers who have proposed various provisioning, adaptive marking and admission control schemes. In this paper, we propose a Reinforcement Learning-based Adaptive Marking (RLAM) approach for providing assured end-to-end quality of service (QoS) in the form of end-to-end delay and throughput assurances, while minimizing packet transmission cost since 'expensive' Per Hop Behaviors like Expedited Forwarding (EF) are used only when necessary. The proposed scheme tries to satisfy per flow end-to-end QoS through control action,s which act on flow aggregates in the core of the network. Using an ns2 simulation of a multi-domain DiffServ network with multimedia traffic, the RLAM scheme is shown to be effective in significantly lowering packet transmission costs without sacrificing end-to-end QoS, when compared to the commonly used static marking scheme.