Q-learning for joint access decision in heterogeneous networks

  • Authors:
  • L. Saker;S. Ben Jemaa;S. E. Elayoubi

  • Affiliations:
  • Orange Labs, Issy les Moulineaux, France;Orange Labs, Issy les Moulineaux, France;Orange Labs, Issy les Moulineaux, France

  • Venue:
  • WCNC'09 Proceedings of the 2009 IEEE conference on Wireless Communications & Networking Conference
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper, we focus on mobile-centered decision making in heterogeneous networks. We study the case where the JRRM decision is completely distributed so that mobile users have to decide to which of the available systems it is best to connect. To optimize their decision over the time, the mobiles implement a Q-learning algorithm that enables them to profit from their past experience. We study the performance of this decision-making framework in the case of a WiMAX/HSDPA heterogeneous network and show that the mobile decision is progressively enhanced until convergence.