The analysis of cluster interconnect with the network tests2 toolkit

Authors:
Alexey Salnikov;Dmitry Andreev;Roman Lebedev
Affiliations:
Lomonosov Moscow State University, Dorodnicyn Computing Centre of RAS, Moscow National research nuclear university "MEPhI";Lomonosov Moscow State University, Dorodnicyn Computing Centre of RAS, Moscow National research nuclear university "MEPhI";Lomonosov Moscow State University, Dorodnicyn Computing Centre of RAS, Moscow National research nuclear university "MEPhI"
Venue:
EuroMPI'11 Proceedings of the 18th European MPI Users' Group conference on Recent advances in the message passing interface
Year:
2011

Citing 6
Cited 0

Achieving Performance Portability with SKaMPI for High-Performance MPI Programs

ICCS '01 Proceedings of the International Conference on Computational Science-Part II
Protocol-Dependent Message-Passing Performance on Linux Clusters

CLUSTER '02 Proceedings of the IEEE International Conference on Cluster Computing
Comparing Ethernet and Myrinet for MPI communication

LCR '04 Proceedings of the 7th workshop on Workshop on languages, compilers, and run-time support for scalable systems
MPIBlib: Benchmarking MPI Communications for Parallel Computing on Homogeneous and Heterogeneous Clusters

Proceedings of the 15th European PVM/MPI Users' Group Meeting on Recent Advances in Parallel Virtual Machine and Message Passing Interface
MPI on a Million Processors

Proceedings of the 16th European PVM/MPI Users' Group Meeting on Recent Advances in Parallel Virtual Machine and Message Passing Interface
PARUS: a parallel programming framework for heterogeneous multiprocessor systems

EuroPVM/MPI'06 Proceedings of the 13th European PVM/MPI User's Group conference on Recent advances in parallel virtual machine and message passing interface

Quantified Score

Hi-index	0.00

Visualization

Abstract

The article discusses MPI-2 tools for benchmarking and extracting information on features of interconnect in HPC clusters. Authors develop a toolkit named "network tests2". This toolkit highlights hidden cluster's topology, illuminates the so-called "jump points" in latency during message transfer, allows user to search defective cluster nodes and so on. The toolkit consists of several programs. The first one is an MPI-program that performs message transfer in several modes to provide certain communication activity or benchmarking of a chosen MPI-function and collects some statistics. The output of this program is a set of communicative matrices which are stored as a NetCDF file. The toolkit includes programs that perform data clustering and provide GUI for visualisation and comparison of results obtained from different clusters. This article touches some results obtained from Russian supercomputers such as Lomonosov T500 system. We also present data on Infiniband Mellanox and Blue Gene/P interconnect technologies.