Matrix-Matrix Multiplication on Heterogeneous Platforms

Authors:
Olivier Beaumont;Vincent Boudet;Fabrice Rastello;Yves Robert
Affiliations:
-;-;-;-
Venue:
ICPP '00 Proceedings of the Proceedings of the 2000 International Conference on Parallel Processing
Year:
2000

Citing 7
Cited 7

Introduction to parallel computing: design and analysis of algorithms

Introduction to parallel computing: design and analysis of algorithms
A high-performance matrix-multiplication algorithm on a distributed-memory parallel computer, using overlapped communication

IBM Journal of Research and Development
Customized dynamic load balancing for a network of workstations

Journal of Parallel and Distributed Computing
ScaLAPACK user's guide

ScaLAPACK user's guide
The grid: blueprint for a new computing infrastructure

The grid: blueprint for a new computing infrastructure
High-performance schedulers

The grid
Heterogeneous Distribution of Computations While Solving Linear Algebra Problems on Networks of Heterogeneous Computers

HPCN Europe '99 Proceedings of the 7th International Conference on High-Performance Computing and Networking

Matrix Multiplication on Heterogeneous Platforms

IEEE Transactions on Parallel and Distributed Systems
Dense linear algebra kernels on heterogeneous platforms: redistribution issues

Parallel Computing - Parallel matrix algorithms and applications
Static LU Decomposition on Heterogeneous Platforms

International Journal of High Performance Computing Applications
Performance effective pre-scheduling strategy for heterogeneous grid systems in the master slave paradigm

Future Generation Computer Systems
On improving resource utilization and system throughput of master slave job scheduling in heterogeneous systems

The Journal of Supercomputing
Grid enabled master slave task scheduling for heterogeneous processor paradigm

GCC'05 Proceedings of the 4th international conference on Grid and Cooperative Computing
Scheduling of job combination and dispatching strategy for grid and cloud system

GPC'10 Proceedings of the 5th international conference on Advances in Grid and Pervasive Computing

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper, we address the issue of implementing matrix-matrix multiplication on heterogeneous platforms. We target two different classes of heterogeneous computing resources: heterogeneous networks of workstations, and collections of heterogeneous clusters. Intuitively, the problem is to load balance the work with different-speed resources while minimizing the communication volume. We formally state this problem and prove its NP-completeness. Next, we introduce a (polynomial) column-based heuristic, which turns out to be very satisfactory: we derive a theoretical performance guarantee for the heuristic, and we assess its practical usefulness through MPI experiments.