Concurrent number cruncher: a GPU implementation of a general sparse linear solver

  • Authors:
  • Luc Buatois;Guillaume Caumon;Bruno Levy

  • Affiliations:
  • ENSG/CRPG, Gocad Research Group, Nancy University, Vandoeuvre-les-Nancy, France,INRIA Lorraine, ALICE, Vandoeuvre-les-Nancy Cedex, France;ENSG/CRPG, Gocad Research Group, Nancy University, Vandoeuvre-les-Nancy, France;INRIA Lorraine, ALICE, Vandoeuvre-les-Nancy Cedex, France

  • Venue:
  • International Journal of Parallel, Emergent and Distributed Systems
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

A wide class of numerical methods needs to solve a linear system, where the matrix pattern of non-zero coefficients can be arbitrary. These problems can greatly benefit from highly multithreaded computational power and large memory bandwidth available on graphics processor units (GPUs), especially since dedicated general purpose APIs such as close-to-metal (CTM) (AMD-ATI) and compute unified device architecture (CUDA) (NVIDIA) have appeared. CUDA even provides a BLAS implementation, but only for dense matrices (CuBLAS). Other existing linear solvers for the GPU are also limited by their internal matrix representation. This paper describes how to combine recent GPU programming techniques and new GPU dedicated APIs with high performance computing strategies (namely block compressed row storage (BCRS), register blocking and vectorization), to implement a sparse general-purpose linear solver. Our implementation of the Jacobi-preconditioned conjugate gradient algorithm outperforms by up to a factor of 6.0 × leading-edge CPU counterparts, making it attractive for applications which are content with single precision.