Optimization of Sparse Matrix Redistribution on Multicomputers

  • Authors:
  • Affiliations:
  • Venue:
  • ICPPW '02 Proceedings of the 2002 International Conference on Parallel Processing Workshops
  • Year:
  • 2002

Quantified Score

Hi-index 0.00

Visualization

Abstract

In many scientific applications, dynamic data redistribution of sparse matrix is used to enhance the performance of SPMD programs. Since the redistribution is performed at runtime, it is critical to the performance of a parallel program. In this paper, we present a new method, which aims to the efficiency of block-cyclic data redistribution of sparse matrix. The main idea of the proposed technique is first to develop closed forms for generating the vector index set of each source/destination processor. Based on the vector index set and the non-zero structure of sparse matrix, two efficient algorithms, vector2message (v2m) and message2vector (m2v) can be derived. The v2m algorithm is used to extract non-zero elements from source matrix and packs them into messages while m2v is used to unpack messages and construct the destination matrix. A theoretical model to analyze the performance of the proposed technique is also presented in this paper. Our method is compared to a dense redistribution strategy and the Histogram method on an IBM SP2 parallel machine. The experimental results show that our techniques can efficiently perform sparse matrix data redistribution.