A Restless Bandit Marginal Productivity Index for Opportunistic Spectrum Access with Sensing Errors

  • Authors:
  • José Niño-Mora

  • Affiliations:
  • Department of Statistics, Carlos III University of Madrid, Leganés (Madrid), Spain 28911

  • Venue:
  • NET-COOP '09 Proceedings of the 3rd Euro-NF Conference on Network Control and Optimization
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper introduces a tractable priority-index multichannel sensing policy in a discrete-time model of opportunistic spectrum access for cognitive radio networks, which aims to be close to optimal under a discounted or average throughput minus sensing cost performance objective. The policy dynamically allocates transmission opportunities arising in a collection of asymmetric channels licensed to primary users to a set of secondary unlicensed users. Channel availabilities follow independent binary-state Markov dynamics, and are partially observed via error-prone spectrum sensors. The paper formulates the model as a multiarmed restless bandit problem with real-state projects, and then deploys Whittle's (1988) marginal productivity (MP) index policy. The challenging issues of indexability (existence of the index) and efficient index evaluation are resolved by deploying recent results of the author for real-state restless bandit indexation. Preliminary computational results are reported showing that the MP policy can achieve substantial gains over the myopic and random policies.