DMATiler: revisiting loop tiling for direct memory access

  • Authors:
  • Haibo Lin;Tao Liu;Huoding Li;Tong Chen;Lakshminarayanan Renganarayana;John Kevin O'Brien;Ling Shao

  • Affiliations:
  • IBM Research - China, Beijing, China;IBM Research - China, Beijing, China;IBM Systems & Technology Group, Beijing, China;IBM Watson Research Center, Yorktown Heights, USA;IBM Watson Research Center, Yorktown Heights, USA;IBM Watson Research Center, Yorktown Heights, USA;IBM Research - China, Beijing, China

  • Venue:
  • Proceedings of the 19th international conference on Parallel architectures and compilation techniques
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper we present the design and implementation of a DMATiler which combines compiler analysis and runtime management to optimize local memory performance. In traditional cache model based loop tiling optimizations, the compiler approximates runtime cache misses as the number of distinct cache lines touched by a loop nest. In contrast, the DMATiler has the full control of the addresses, sizes, and sequences of data transfers. DMATiler uses a simplified DMA performance model to formulate the cost model for DMA-tiled loop nests, then solves it using a custom gradient descent algorithm with heuristics guided by DMA characteristics. Given a loop nest, DMATiler uses loop interchange to make the loop order more friendlier for data movements. Moreover, DMATiler applies compressed data buffer and advanced DMA command to further optimize data transfers. We have implemented the DMATiler in the IBM XL C/C++ for Multi-core Acceleration for Linux, and have conducted experiments with a set of loop nest benchmarks. The results show DMATiler is much more efficient than software controlled cache (average speedup of 9.8x) and single level loop blocking (average speedup of 6.2x) on the Cell BE processor.