Performance analysis of overheads for matrix – vector multiplication in cluster environment

Authors:
Panagiotis D. Michailidis;Vasilis Stefanidis;Konstantinos G. Margaritis
Affiliations:
Parallel and Distributed Processing Laboratory, Department of Applied Informatics, University of Macedonia, Thessaloniki, Greece;Parallel and Distributed Processing Laboratory, Department of Applied Informatics, University of Macedonia, Thessaloniki, Greece;Parallel and Distributed Processing Laboratory, Department of Applied Informatics, University of Macedonia, Thessaloniki, Greece
Venue:
PCI'05 Proceedings of the 10th Panhellenic conference on Advances in Informatics
Year:
2005

Citing 10
Cited 0

Solving problems on concurrent processors

Solving problems on concurrent processors
LAPACK's user's guide

LAPACK's user's guide
Introduction to parallel computing: design and analysis of algorithms

Introduction to parallel computing: design and analysis of algorithms
Parallel programming with MPI

Parallel programming with MPI
An effective and practical performance prediction model for parallel computing on nondedicated heterogeneous NOW

Journal of Parallel and Distributed Computing
Matrix Multiplication on Heterogeneous Platforms

IEEE Transactions on Parallel and Distributed Systems
MPI: The Complete Reference

MPI: The Complete Reference
Heterogeneous Networks of Workstations and the Parallel Matrix Multiplication

Proceedings of the 8th European PVM/MPI Users' Group Meeting on Recent Advances in Parallel Virtual Machine and Message Passing Interface
Parallel Programming: Techniques and Applications Using Networked Workstations and Parallel Computers (2nd Edition)

Parallel Programming: Techniques and Applications Using Networked Workstations and Parallel Computers (2nd Edition)
Scalability Analysis of Matrix-Matrix Multiplication on Heterogeneous Clusters

ISPDC '04 Proceedings of the Third International Symposium on Parallel and Distributed Computing/Third International Workshop on Algorithms, Models and Tools for Parallel Computing on Heterogeneous Networks

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper presents the basic parallel implementation and a variation for matrix – vector multiplication. We evaluated and compared the performance of the two implementations on a cluster of workstations using Message Passing Interface (MPI) library. The experimental results demonstrate that the basic implementation achieves lower performance than the other variation. Further, we analyzed the several classes of overheads contribute to lowered performance of the basic implementation. These analyses have identified cost of reading of data from disk and communication cost as the primary factors affecting performance of the basic parallel matrix – vector implementation. Finally, we present a performance model for estimating the performance of two proposed matrix – vector implementations on a cluster of heterogeneous workstations.