Advances, Applications and Performance of the Global Arrays Shared Memory Programming Toolkit
International Journal of High Performance Computing Applications
Memory efficient parallel matrix multiplication operation for irregular problems
Proceedings of the 3rd conference on Computing frontiers
| Hi-index | 0.00 |
In many applications, matrix multiplication involvesdifferent shapes of matrices. The shape of the matrix cansignificantly impact the performance of matrixmultiplication algorithm. This paper describes extensionsof the SRUMMA parallel matrix multiplication algorithm[1] to improve performance of transpose and rectangularmatrices. Our approach relies on a set of hybrid algorithmswhich are chosen based on the shape of matrices andtranspose operator involved. The algorithm exploitsperformance characteristics of clusters and shared memorysystems: it differs from the other parallel matrixmultiplication algorithms by the explicit use of sharedmemory and remote memory access (RMA) communicationrather than message passing. The experimental results onclusters and shared memory systems demonstrateconsistent performance advantages over pdgemm from theScaLAPACK parallel linear algebra package.