In-place algorithms for the symmetric all-to-all exchange with MPI

Authors:
Michael Hofmann;Gudula Rünger
Affiliations:
Chemnitz University of Technology, Chemnitz, Germany;Chemnitz University of Technology, Chemnitz, Germany
Venue:
Proceedings of the 20th European MPI Users' Group Meeting
Year:
2013

Citing 8
Cited 0

The Hierarchical Factor Algorithm for All-to-All Communication (Research Note)

Euro-Par '02 Proceedings of the 8th International Euro-Par Conference on Parallel Processing
Fine-Grained Data Distribution Operations for Particle Codes

Proceedings of the 16th European PVM/MPI Users' Group Meeting on Recent Advances in Parallel Virtual Machine and Message Passing Interface
MPC-MPI: An MPI Implementation Reducing the Overall Memory Consumption

Proceedings of the 16th European PVM/MPI Users' Group Meeting on Recent Advances in Parallel Virtual Machine and Message Passing Interface
Madre: the Memory-Aware Data Redistribution Engine

International Journal of High Performance Computing Applications
An in-place algorithm for irregular all-to-all communication with limited memory

EuroMPI'10 Proceedings of the 17th European MPI users' group meeting conference on Recent advances in the message passing interface
Scalable memory use in MPI: a case study with MPICH2

EuroMPI'11 Proceedings of the 18th European MPI Users' Group conference on Recent advances in the message passing interface
Alternative, uniformly expressive and more scalable interfaces for collective communication in MPI

Parallel Computing
The IBM Blue Gene/Q Compute Chip

IEEE Micro

Quantified Score

Hi-index	0.00

Visualization

Abstract

The article presents two efficient in-place algorithms for the symmetric all-to-all exchange of the MPI_Alltoallv operation. The first algorithm performs a series of pairwise data exchanges similar to the existing algorithm used by MPICH, but with fewer consecutive communication steps and idle processes. The second algorithm uses hierarchical sets of processes that lead to a better locality of communication. Exploiting additionally available memory for performance improvements is described. Performance results for an InfiniBand cluster and an IBM Blue Gene/Q system demonstrate the performance benefits of the algorithms within a generic benchmark program and an FFT application.