Assessing the appropriateness of using markov decision processes for RF spectrum management

  • Authors:

  • John Meier;Benjamin Karaus;Sreeharsha Sistla;Terry Tidwell;Roger D. Chamberlain;Christopher Gill

  • Affiliations:

  • Washington University in St. Louis, Saint Louis, MO, USA;Washington University in St. Louis, Saint Louis, MO, USA;Washington University in St. Louis, Saint Louis, MO, USA;Washington University in St. Louis, Saint Louis, MO, USA;Washington University in St. Louis, Saint Louis, MO, USA;Washington University in St. Louis, Saint Louis, MO, USA

  • Venue:
  • Proceedings of the 16th ACM international conference on Modeling, analysis & simulation of wireless and mobile systems
  • Year:
  • 2013

Quantified Score

Hi-index 0.00

Visualization

Abstract

The stochastic nature of wireless communication suggests a Markov Decision Process (MDP) as a formalism for identifying and evaluating spectrum control policies. However, in practice numerous factors influence the success or failure of a transmission, so that the applicability of particular MDP models to real spectrum management problems must itself be examined. This paper presents a series of model validation studies in which correspondence between an MDP model and a discrete-event simulation (DES) model is evaluated. We test several hypotheses that together provide a foundation and an exemplar for the idea of using MDPs to guide management of shared spectrum. We conclude that there is sufficient similarity between the performance predictions made by the MDP model and the DES model that MDPs can be used effectively to determine spectrum control policies.