Approximate dynamic programming techniques for the control of time-varying queuing systems applied to call centers with abandonments and retrials

  • Authors:
  • Dennis Roubos;Sandjai Bhulai

  • Affiliations:
  • Vu university amsterdam, faculty of sciences, 1081 hv amsterdam, the netherlands e-mail: droubos@few.vu.nl/ sbhulai@few.vu.nl;Vu university amsterdam, faculty of sciences, 1081 hv amsterdam, the netherlands e-mail: droubos@few.vu.nl/ sbhulai@few.vu.nl

  • Venue:
  • Probability in the Engineering and Informational Sciences
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this article we develop techniques for applying Approximate Dynamic Programming (ADP) to the control of time-varying queuing systems. First, we show that the classical state space representation in queuing systems leads to approximations that can be significantly improved by increasing the dimensionality of the state space by state disaggregation. Second, we deal with time-varying parameters by adding them to the state space with an ADP parameterization. We demonstrate these techniques for the optimal admission control in a retrial queue with abandonments and time-varying parameters. The numerical experiments show that our techniques have near to optimal performance.