Congestion control as a stochastic control problem with action delays

  • Authors:
  • Eitan Altman;Tamer Başar;R. Srikant

  • Affiliations:
  • INRIA B.P. 93, 06902 Sophia Antipolis Cedex, France;Coordinated Science Laboratory and Department of Electrical and Computer Engineering, University of Illinois, 1308 West Main Street, Urbana, IL 61801, USA;Coordinated Science Laboratory and Department of General Engineering, University of Illinois, 1308 West Main Street, Urbana, IL 61801, USA

  • Venue:
  • Automatica (Journal of IFAC)
  • Year:
  • 1999

Quantified Score

Hi-index 22.15

Visualization

Abstract

We consider the design of explicit rate-based congestion control for high-speed communication networks and show that this can be formulated as a stochastic control problem where the controls of different users enter the system dynamics with different delays. We discuss the existence, derivation and the structure of the optimal controller, as well as of suboptimal controllers of the certainty-equivalent type - a terminology that is precisely defined in the paper for the specific context of the congestion control problem considered. We consider, in particular, two certainty-equivalent controllers which are easy to implement, and show that they are stabilizing, i.e., they lead to bounded infinite-horizon average cost, and stable queue dynamics. Further, these controllers perform well in simulations.