Using CMT in SCTP-based MPI to exploit multiple interfaces in cluster nodes

Authors:
Brad Penoff;Mike Tsai;Janardhan Iyengar;Alan Wagner
Affiliations:
University of British Columbia, Vancouver, BC, Canada;University of British Columbia, Vancouver, BC, Canada;Computer Science, Connecticut College, New London, CT;University of British Columbia, Vancouver, BC, Canada
Venue:
PVM/MPI'07 Proceedings of the 14th European conference on Recent Advances in Parallel Virtual Machine and Message Passing Interface
Year:
2007

Citing 9
Cited 5

Stream control transmission protocol (SCTP): a reference guide

Stream control transmission protocol (SCTP): a reference guide
Building Multirail InfiniBand Clusters: MPI-Level Design and Performance Evaluation

Proceedings of the 2004 ACM/IEEE conference on Supercomputing
End-to-end fault tolerance using transport layer multihoming

End-to-end fault tolerance using transport layer multihoming
SCTP versus TCP for MPI

SC '05 Proceedings of the 2005 ACM/IEEE conference on Supercomputing
High-performance message striping over reliable transport protocols

The Journal of Supercomputing
A software based approach for providing network fault tolerance in clusters with uDAPL interface: MPI level design and performance evaluation

Proceedings of the 2006 ACM/IEEE conference on Supercomputing
End-to-end concurrent multipath transfer using transport layer multihoming

End-to-end concurrent multipath transfer using transport layer multihoming
Concurrent multipath transfer using SCTP multihoming over independent end-to-end paths

IEEE/ACM Transactions on Networking (TON)
Concurrent multipath transfer using transport layer multihoming: performance under network failures

MILCOM'06 Proceedings of the 2006 IEEE conference on Military communications

Employing transport layer multi-railing in cluster networks

Journal of Parallel and Distributed Computing
Implementation and evaluation of concurrent multipath transfer for SCTP in the INET framework

Proceedings of the 3rd International ICST Conference on Simulation Tools and Techniques
A case study of transport protocols to improve the execution of applications in virtual organisations utilising multicluster network configurations

International Journal of Networking and Virtual Organisations
SCTP, XTP and TCP as transport protocols for high performance computing on multi-cluster grid environments

HPCS'09 Proceedings of the 23rd international conference on High Performance Computing Systems and Applications
High performance concurrent multi-path communication for MPI

EuroMPI'12 Proceedings of the 19th European conference on Recent Advances in the Message Passing Interface

Quantified Score

Hi-index	0.00

Visualization

Abstract

Many existing clusters use inexpensive Gigabit Ethernet and often have multiple interfaces cards to improve bandwidth and enhance fault tolerance. We investigate the use of Concurrent Multipath Transfer (CMT), an extension to the Stream Control Transmission Protocol (SCTP), to take advantage of multiple network interfaces for use with MPI programs. We evaluate the performance of our system with microbenchmarks and MPI collective routines. We also compare our method, which employs CMT at the transport layer in the operating system kernel, to existing systems that support multi-railing in the middleware. We discuss performance with respect to bandwidth, latency, congestion control and fault tolerance.