Comparing Ethernet and Myrinet for MPI communication

Authors:
Supratik Majumder;Scott Rixner
Affiliations:
Rice University, Houston, Texas;Rice University, Houston, Texas
Venue:
LCR '04 Proceedings of the 7th workshop on Workshop on languages, compilers, and run-time support for scalable systems
Year:
2004

Citing 12
Cited 5

A high-performance, portable implementation of the MPI message passing interface standard

Parallel Computing
A network-failure-tolerant message-passing system for terascale clusters

ICS '02 Proceedings of the 16th international conference on Supercomputing
EMP: zero-copy OS-bypass NIC-driven gigabit ethernet message passing

Proceedings of the 2001 ACM/IEEE conference on Supercomputing
Myrinet: A Gigabit-per-Second Local Area Network

IEEE Micro
The Quadrics Network: High-Performance Clustering Technology

IEEE Micro
Can User-Level Protocols Take Advantage of Multi-CPU NICs?

IPDPS '02 Proceedings of the 16th International Parallel and Distributed Processing Symposium
Deferred Segmentation for Wire-Speed Transmission of Large TCP Frames over Standard GbE Networks

HOTI '01 Proceedings of the The Ninth Symposium on High Performance Interconnects
Isolating the performance impacts of network interface cards through microbenchmarks

Proceedings of the joint international conference on Measurement and modeling of computer systems
Architectural Characterization of TCP/IP Packet Processing on the Pentium® M Microprocessor

HPCA '04 Proceedings of the 10th International Symposium on High Performance Computer Architecture
High-performance local area communication with fast sockets

ATEC '97 Proceedings of the annual conference on USENIX Annual Technical Conference
Trapeze/IP: TCP/IP at near-gigabit speeds

ATEC '99 Proceedings of the annual conference on USENIX Annual Technical Conference
End system optimizations for high-speed TCP

IEEE Communications Magazine

Connection-less TCP

IPDPS '05 Proceedings of the 19th IEEE International Parallel and Distributed Processing Symposium (IPDPS'05) - Workshop 9 - Volume 10
Averages, distributions and scalability of MPI communication times for Ethernet and Myrinet networks

PDCN'07 Proceedings of the 25th conference on Proceedings of the 25th IASTED International Multi-Conference: parallel and distributed computing and networks
Towards MPI progression layer elimination with TCP and SCTP

IPDPS'06 Proceedings of the 20th international conference on Parallel and distributed processing
Seekable sockets: a mechanism to reduce copy overheads in TCP-based messaging

IPDPS'06 Proceedings of the 20th international conference on Parallel and distributed processing
The analysis of cluster interconnect with the network tests2 toolkit

EuroMPI'11 Proceedings of the 18th European MPI Users' Group conference on Recent advances in the message passing interface

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper compares the performance of Myrinet and Ethernet as a communication substrate for MPI libraries. MPI library implementations for Myrinet utilize user-level communication protocols to provide low latency and high bandwidth MPI messaging. In contrast, MPI library implementations for Ethernet utilize the operating system network protocol stack, leading to higher message latency and lower message bandwidth. However, on the NAS benchmarks, GM messaging over Myrinet only achieves 5% higher application performance than TCP messaging over Ethernet. Furthermore, efficient TCP messaging implmentations improve communication latency tolerance, which closes the performance gap between Myrinet and Ethernet to about 0.3% on the NAS benchmarks. This shows that commodity networking, if used efficiently, can be a viable alternative to specialized networking for high-performance message passing.