Boosting CUDA Applications with CPU---GPU Hybrid Computing

  • Authors:
  • Changmin Lee;Won Woo Ro;Jean-Luc Gaudiot

  • Affiliations:
  • Yonsei University, Seoul, Republic of Korea 120-749;Yonsei University, Seoul, Republic of Korea 120-749;University of California, Irvine, USA 92697-2625

  • Venue:
  • International Journal of Parallel Programming
  • Year:
  • 2014

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper presents a cooperative heterogeneous computing framework which enables the efficient utilization of available computing resources of host CPU cores for CUDA kernels, which are designed to run only on GPU. The proposed system exploits at runtime the coarse-grain thread-level parallelism across CPU and GPU, without any source recompilation. To this end, three features including a work distribution module, a transparent memory space, and a global scheduling queue are described in this paper. With a completely automatic runtime workload distribution, the proposed framework achieves speedups of 3.08 $$\times $$ 脳 in the best case and 1.42 $$\times $$ 脳 on average compared to the baseline GPU-only processing.