Scheduling Straight-Line Code Using Reinforcement Learning and Rollouts

  • Authors:
  • A. McGovern;E. Moss;A. Barto

  • Affiliations:
  • -;-;-

  • Venue:
  • Scheduling Straight-Line Code Using Reinforcement Learning and Rollouts
  • Year:
  • 1999

Quantified Score

Hi-index 0.00

Visualization

Abstract

The execution order of a block of computer instructions on a pipelined machine can make a difference in its running time by a factor of two or more. In order to achieve the best possible speed, compilers use heuristic schedulers appropriate to each specific architecture implementation. However, these heuristic schedulers are time-consuming and expensive to build. We present empirical results using both rollouts and reinforcement learning to construct heuristics for scheduling basic blocks. In simulation, the rollout scheduler outperformed a commercial scheduler, and the reinforcement learning scheduler performed almost as well as the commercial scheduler.