Reducing Cache Miss Rates Using Prediction Caches

  • Authors:
  • James E. Bennett;Michael J. Flynn

  • Affiliations:
  • -;-

  • Venue:
  • Reducing Cache Miss Rates Using Prediction Caches
  • Year:
  • 1996

Quantified Score

Hi-index 0.00

Visualization

Abstract

Processor cycle times are currently much faster than memory cycle times, and the trend has been for this gap to increase over time. The problem of increasing memory latency, relative to processor speed, has been dealt with by adding high speed cache memory. However, it is difficult to make a cache both large and fast, so that cache misses are expected to continue to have a significant performance impact. Prediction caches use a history of recent cache misses to predict future misses, and to reduce the overall cache miss rate. This paper describes several prediction caches, and introduces a new kind of prediction cache, which combines the features of prefetching and victim caching. This new cache is shown to be more effective at reducing miss rate and improving performance than existing prediction caches.