An afterstates reinforcement learning approach to optimize admission control in mobile cellular networks

  • Authors:
  • José Manuel Giménez-Guzmán;Jorge Martínez-Bauset;Vicent Pla

  • Affiliations:
  • Departamento de Comunicaciones, Universidad Politècnica de València, UPV, ETSIT, València, Spain;Departamento de Comunicaciones, Universidad Politècnica de València, UPV, ETSIT, València, Spain;Departamento de Comunicaciones, Universidad Politècnica de València, UPV, ETSIT, València, Spain

  • Venue:
  • EURO-NGI'05 Proceedings of the Second international conference on Wireless Systems and Network Architectures in Next Generation Internet
  • Year:
  • 2005

Quantified Score

Hi-index 0.00

Visualization

Abstract

We deploy a novel Reinforcement Learning optimization technique based on afterstates learning to determine the gain that can be achieved by incorporating movement prediction information in the session admission control process in mobile cellular networks. The novel technique is able to find better solutions and with less dispersion. The gain is obtained by evaluating the performance of optimal policies achieved with and without the predictive information, while taking into account possible prediction errors. The prediction agent is able to determine the handover instants both stochastically and deterministically. Numerical results show significant performance gains when the predictive information is used in the admission process, and that higher gains are obtained when deterministic handover instants can be determined.