Saving energy with just in time instruction delivery

  • Authors:
  • Tejas Karkhanis;James E. Smith;Pradip Bose

  • Affiliations:
  • Univ. of Wisconsin - Madison, Madison, WI;Univ. of Wisconsin - Madison, Madison, WI;IBM T J Watson Research Center, Yorktown Heights, NY

  • Venue:
  • Proceedings of the 2002 international symposium on Low power electronics and design
  • Year:
  • 2002

Quantified Score

Hi-index 0.00

Visualization

Abstract

Just-In-Time instruction delivery is a general method for saving energy in a microprocessor by dynamically limiting the number of in-flight instructions. The goal is to save energy by 1) fetching valid instructions no sooner than necessary, avoiding cycles stalled in the pipeline -- especially the issue queue, and 2) reducing the number of fetches and subsequent processing of mis-speculated instructions. A simple algorithm monitors performance and adjusts the maximum number of in-flight instructions at fairly long intervals, 100K instructions in this study. The proposed JIT instruction delivery scheme provides the combined benefits of more targeted schemes proposed previously. With only a 3% performance degradation, energy savings in the fetch, decode pipe, and issue queue are 10%, 12%, and 40%, respectively.