Prediction of communication latency over complex network behaviors on SMP clusters

Authors:
Maxime Martinasso;Jean-François Méhaut
Affiliations:
Laboratoire ID-IMAG, ZIRST, MontBonnot Saint-Martin, France;Laboratoire ID-IMAG, ZIRST, MontBonnot Saint-Martin, France
Venue:
EPEW'05/WS-FM'05 Proceedings of the 2005 international conference on European Performance Engineering, and Web Services and Formal Methods, international conference on Formal Techniques for Computer Systems and Business Processes
Year:
2005

Citing 7
Cited 1

LogGP: incorporating long messages into the LogP model—one step closer towards a realistic model for parallel computation

Proceedings of the seventh annual ACM symposium on Parallel algorithms and architectures
LogP: a practical model of parallel computation

Communications of the ACM
Effects of communication latency, overhead, and bandwidth in a cluster architecture

Proceedings of the 24th annual international symposium on Computer architecture
Performance modeling and evaluation of MPI

Journal of Parallel and Distributed Computing
Measurement and prediction of communication delays in myrinet networks

Journal of Parallel and Distributed Computing - Special issue on cluster and network-based computing
High Speed Networks for Clusters, the BIP-Myrinet Experience

Proceedings of the 7th European PVM/MPI Users' Group Meeting on Recent Advances in Parallel Virtual Machine and Message Passing Interface
Performance Comparison of MPI Implementations over InfiniBand, Myrinet and Quadrics

Proceedings of the 2003 ACM/IEEE conference on Supercomputing

Adaptive-Compi: Enhancing Mpi-Based Applications - Performance and Scalability by using Adaptive Compression

International Journal of High Performance Computing Applications

Quantified Score

Hi-index	0.00

Visualization

Abstract

Using MPI as communication interface, one or several applications may introduce complex communication behaviors over the network of a cluster. This effect is increased when nodes of the cluster are multi-processors, and where communications can income or outgo from the same node with a common interval time. Our interest is to understand the effects of complex communication schemes over a network of SMP nodes, and then to identify different network conflicts. Network conflicts stand for a network component (links, NIC, or MPI stack, etc.) shared between communications. This paper describes a set of experiments generating network conflicts and their analysis, in order to accurately predict communication latencies. This analysis is based on cluster of bi-processor with a Myrinet network, using as communication interface a LAM MPI-2 implementation over GM protocol.