Reducing the Impact of the MemoryWall for I/O Using Cache Injection

  • Authors:
  • Edgar A. Leon;Kurt B. Ferreira;Arthur B. Maccabe

  • Affiliations:
  • University of New Mexico;University of New Mexico;University of New Mexico

  • Venue:
  • HOTI '07 Proceedings of the 15th Annual IEEE Symposium on High-Performance Interconnects
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

Cache injection addresses the continuing disparity be- tween processor and memory speeds by placing data into a processor's cache directly from the I/O bus. This disparity adversely affects the performance of memory bound appli- cations including certain scientific computations, encryp- tion, image processing, and some graphics applications. Cache injection can reduce memory latency and memory pressure for I/O. The performance of cache injection is de- pendent on several factors including timely usage of data, the amount of data, and the application's data usage pat- terns. We show that cache injection provides significant ad- vantages over data prefetching by reducing the pressure on the memory controller by up to 96%. Despite its benefits, cache injection may degrade application performance due to early injection of data. To overcome this limitation, we propose injection policies to determine when and where to inject data. These policies are based on OS, compiler, and application information.