A Multi-State Q-Learning Approach for the Dynamic Load Balancing of Time Warp

  • Authors:
  • Sina Meraji; Wei Zhang;Carl Tropper

  • Affiliations:
  • Sch. of Comput. Sci., McGill Univ., Montreal, QC, Canada;Sch. of Comput. Sci., McGill Univ., Montreal, QC, Canada;Sch. of Comput. Sci., McGill Univ., Montreal, QC, Canada

  • Venue:
  • PADS '10 Proceedings of the 2010 IEEE Workshop on Principles of Advanced and Distributed Simulation
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper, we present a dynamic load-balancing algorithm for optimistic gate level simulation making use of a machine learning approach. We first introduce two dynamic load-balancing algorithms oriented towards balancing the computational and communication load respectively in a Time Warp simulator. In addition, we utilize a multi-state Q-learning approach to create an algorithm which is a combination of the first two algorithms. The Q-learning algorithm determines the value of three important parameters- the number of processors which participate in the algorithm, the load which is exchanged during its execution and the type of load-balancing algorithm. We investigate the algorithm on gate level simulations of several open source VLSI circuits.