Accelerating the reduction to upper Hessenberg, tridiagonal, and bidiagonal forms through hybrid GPU-based computing

  • Authors:
  • Stanimire Tomov;Rajib Nath;Jack Dongarra

  • Affiliations:
  • University of Tennessee, Department of Electrical Engineering and Computer Science, 1122 Volunteer Blvd., Knoxville, TN 37996-3450, USA;University of Tennessee, Department of Electrical Engineering and Computer Science, 1122 Volunteer Blvd., Knoxville, TN 37996-3450, USA;University of Tennessee, Department of Electrical Engineering and Computer Science, 1122 Volunteer Blvd., Knoxville, TN 37996-3450, USA and Oak Ridge National Laboratory, USA and University of Man ...

  • Venue:
  • Parallel Computing
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

We present a Hessenberg reduction (HR) algorithm for hybrid systems of homogeneous multicore with GPU accelerators that can exceed 25x the performance of the corresponding LAPACK algorithm running on current homogeneous multicores. This enormous acceleration is due to proper matching of algorithmic requirements to architectural strengths of the system's hybrid components. The results described in this paper are significant because the HR has not been properly accelerated before on homogeneous multicore architectures, and it plays a significant role in solving non-symmetric eigenvalue problems. Moreover, the ideas from the hybrid HR are used to develop a hybrid tridiagonal reduction algorithm (for symmetric eigenvalue problems) and a bidiagonal reduction algorithm (for singular value decomposition problems). Our approach demonstrates a methodology that streamlines the development of a large and important class of algorithms on modern computer architectures of multicore and GPUs. The new algorithms can be directly used in the software stack that relies on LAPACK.