Vapor SIMD: Auto-vectorize once, run everywhere

  • Authors:
  • Dorit Nuzman;Sergei Dyshel;Erven Rohou;Ira Rosen;Kevin Williams;David Yuste;Albert Cohen;Ayal Zaks

  • Affiliations:
  • IBM Haifa Research Lab, Haifa, Israel - HiPEAC;IBM Haifa Research Lab, Haifa, Israel - HiPEAC;INRIA Rennes - Bretagne Atlantique, Rennes, France - HiPEAC;IBM Haifa Research Lab, Haifa, Israel - HiPEAC;INRIA Rennes - Bretagne Atlantique, Rennes, France - HiPEAC;INRIA Rennes - Bretagne Atlantique, Rennes, France - HiPEAC;INRIA Saclay - Île-de-France, Orsay, France - HiPEAC;IBM Haifa Research Lab, Haifa, Israel - HiPEAC

  • Venue:
  • CGO '11 Proceedings of the 9th Annual IEEE/ACM International Symposium on Code Generation and Optimization
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

Just-in-Time (JIT) compiler technology offers portability while facilitating target- and context-specific specialization. Single-Instruction-Multiple-Data (SIMD) hardware is ubiquitous and markedly diverse, but can be difficult for JIT compilers to efficiently target due to resource and budget constraints. We present our design for a synergistic auto-vectorizing compilation scheme. The scheme is composed of an aggressive, generic offline stage coupled with a lightweight, target-specific online stage. Our method leverages the optimized intermediate results provided by the first stage across disparate SIMD architectures from different vendors, having distinct characteristics ranging from different vector sizes, memory alignment and access constraints, to special computational idioms. We demonstrate the effectiveness of our design using a set of kernels that exercise innermost loop, outer loop, as well as straight-line code vectorization, all automatically extracted by the common offline compilation stage. This results in performance comparable to that provided by specialized monolithic offline compilers. Our framework is implemented using open-source tools and standards, thereby promoting interoperability and extendibility.