Aspects of GPU for general purpose high performance computing

Authors:
Reiji Suda;Takayuki Aoki;Shoichi Hirasawa;Akira Nukada;Hiroki Honda;Satoshi Matsuoka
Affiliations:
The University of Tokyo;Tokyo Institute of Technology;The University of Electro-Communications;Tokyo Institute of Technology;The University of Eletro-Communications;Tokyo Institute of Technology
Venue:
Proceedings of the 2009 Asia and South Pacific Design Automation Conference
Year:
2009

Citing 3
Cited 1

Divisible Load Theory: A New Paradigm for Load Scheduling in Distributed Systems

Cluster Computing
Bandwidth intensive 3-D FFT kernel for GPUs using CUDA

Proceedings of the 2008 ACM/IEEE conference on Supercomputing
Benchmarking GPUs to tune dense linear algebra

Proceedings of the 2008 ACM/IEEE conference on Supercomputing

Evaluating application performance and energy consumption on hybrid CPU+GPU architecture

Cluster Computing

Quantified Score

Hi-index	0.00

Visualization

Abstract

We discuss hardware and software aspects of GPGPU, specifically focusing on NVIDIA cards and CUDA, from the viewpoints of parallel computing. The major weak points of GPU against newest supercomputers are identified to be and summarized as only four points: large SIMD vector length, small memory, absence of fast L2 cache, and high register spill penalty. As software concerns, we derive optimal scheduling algorithm for latency hiding of host-device data transfer, and discuss SPMD parallelism on GPUs.