Performance of distributed multi-agent multi-state reinforcement spectrum management using different exploration schemes

  • Authors:

  • Albert H. R. Ko;Robert Sabourin;FrançOis Gagnon

  • Affiliations:

  • LACIME, ETS, University of Quebec, 1100, Notre-Dame West Street, Montreal, QC, Canada H2W2B9;LACIME, ETS, University of Quebec, 1100, Notre-Dame West Street, Montreal, QC, Canada H2W2B9;LACIME, ETS, University of Quebec, 1100, Notre-Dame West Street, Montreal, QC, Canada H2W2B9

  • Venue:
  • Expert Systems with Applications: An International Journal
  • Year:
  • 2013

Quantified Score

Hi-index 12.05

Visualization

Abstract

This paper introduces a novel multi-agent multi-state reinforcement learning exploration scheme for dynamic spectrum access and dynamic spectrum sharing in wireless communications. With the multi-agent multi-state reinforcement learning, cognitive radios can decide the best channels to use in order to maximize spectral efficiency in a distributed way. However, we argue that the performance of spectrum management, including both dynamic spectrum access and dynamic spectrum sharing, will largely depend on different reinforcement learning exploration schemes, and we believe that the traditional multi-agent multi-state reinforcement learning exploration schemes may not be adequate in the context of spectrum management. We then propose a novel reinforcement learning exploration scheme and show that we can improve the performance of multi-agent multi-state reinforcement learning based spectrum management by using the proposed reinforcement learning exploration scheme. We also investigate various real-world scenarios, and confirm the validity of the proposed method.