LogP: towards a realistic model of parallel computation
PPOPP '93 Proceedings of the fourth ACM SIGPLAN symposium on Principles and practice of parallel programming
Harness: a next generation distributed virtual machine
Future Generation Computer Systems - Special issue on metacomputing
MPI-The Complete Reference, Volume 1: The MPI Core
MPI-The Complete Reference, Volume 1: The MPI Core
Towards an Accurate Model for Collective Communications
ICCS '01 Proceedings of the International Conference on Computational Sciences-Part I
Fault Tolerant MPI for the HARNESS Meta-computing System
ICCS '01 Proceedings of the International Conference on Computational Sciences-Part I
| Hi-index | 0.00 |
The performance of the MPI's collective communications is critical in most MPI-based applications. A general algorithm for a given collective communication operation may not give good performance on all systems due to the differences in architectures, network parameters and the buffering scheme of the underlying MPI implementation. In this paper, we discuss an approach in which the collective communications are tuned for any given system by conducting a series of experiments on the system. We also discuss a dynamic topology method that uses the tuned static topology shape, but re-orders the logical addresses to compensate for changing run time variations. A series of experiments were conducted comparing our tuned MPI_Bcast to various native vendor MPI implementations. The results obtained were encouraging, and show that our implementations of collective algorithms can significantly improve the performance of current MPI implementations.