Dynamic robust power allocation games under channel uncertainty and time delays

  • Authors:
  • Hamidou Tembine;Abdellatif Kobbane;Mohamed El koutbi

  • Affiliations:
  • Ecole Supérieure d'Electricité 3, rue Joliot-Curie, 91192 Gif Sur Yvette Cedex, France;Mohammed V-Souissi University, ENSIAS, Rabat, Morocco;Mohammed V-Souissi University, ENSIAS, Rabat, Morocco

  • Venue:
  • Computer Communications
  • Year:
  • 2011

Quantified Score

Hi-index 0.24

Visualization

Abstract

In this paper, we study dynamic robust power allocation strategies under the imperfectness of the channel state information at the transmitters. Considering unknown payoff functions at the transmitters, we propose an heterogeneous Delayed COmbined fully DIstributed Payoff and Strategy Reinforcement Learning (Delayed-CODIPAS-RL) in which each transmitter learns its payoff function as well as its associated optimal strategies in the long-term. We show that equilibrium power allocations can be obtained using the multiplicative weighted imitative CODIPAS-RLs and Bush-Mosteller based CODIPAS-RL. We also show almost sure convergence to the set of global optima for specific scenarios.