Call Admission Control for Multimedia Cellular Networks Using Neuro-dynamic Programming

  • Authors:
  • Sidi-Mohammed Senouci;André-Luc Beylot;Guy Pujolle

  • Affiliations:
  • -;-;-

  • Venue:
  • NETWORKING '02 Proceedings of the Second International IFIP-TC6 Networking Conference on Networking Technologies, Services, and Protocols; Performance of Computer and Communication Networks; and Mobile and Wireless Communications
  • Year:
  • 2002

Quantified Score

Hi-index 0.01

Visualization

Abstract

We consider, in this paper, the call admission control (CAC) problem in a multimedia cellular network that handles several classes of traffic with different resource requirements. The problem is formulated as a Semi-Markov Decision Process (SMDP) problem. It is too complex to allow for an exact solution for this problem, so, we use a real-time neuro-dynamic programming (NDP) [Reinforcement Learning (RL)] algorithm to construct a dynamic call admission control policy. A broad set of experiments shows the robustness of our policies compared to the classical solutions such as Guard Channel.