The co-design architecture for exascale systems, a novel approach for scalable designs

Authors:
Gilad Shainer;Todd Wilde;Pak Lui;Tong Liu;Michael Kagan;Mike Dubman;Yiftah Shahar;Richard Graham;Pavel Shamis;Steve Poole
Affiliations:
Mellanox Technologies, Sunnyvale, USA;Mellanox Technologies, Sunnyvale, USA;Mellanox Technologies, Sunnyvale, USA;Mellanox Technologies, Sunnyvale, USA;Mellanox Technologies, Sunnyvale, USA;Mellanox Technologies, Sunnyvale, USA;Mellanox Technologies, Sunnyvale, USA;Oak Ridge National Laboratory, Oak Ridge, USA;Oak Ridge National Laboratory, Oak Ridge, USA;Oak Ridge National Laboratory, Oak Ridge, USA
Venue:
Computer Science - Research and Development
Year:
2013

Citing 4
Cited 0

ConnectX-2 InfiniBand Management Queues: First Investigation of the New Support for Network Offloaded Collective Operations

CCGRID '10 Proceedings of the 2010 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing
Network offloaded hierarchical collectives using ConnectX-2's CORE-Direct capabilities

EuroMPI'10 Proceedings of the 17th European MPI users' group meeting conference on Recent advances in the message passing interface
Cheetah: A Framework for Scalable Hierarchical Collective Operations

CCGRID '11 Proceedings of the 2011 11th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing
ConnectX-2 CORE-Direct Enabled Asynchronous Broadcast Collective Communications

IPDPSW '11 Proceedings of the 2011 IEEE International Symposium on Parallel and Distributed Processing Workshops and PhD Forum

Quantified Score

Hi-index	0.00

Visualization

Abstract

High performance computing (HPC) has begun scaling beyond the Petaflop range towards the Exaflop (1000 Petaflops) mark. One of the major concerns throughout the development toward such performance capability is scalability--both at the system level and the application layer. In this paper we present a novel approach for a new design concept--the co-design approach with enables a tighter development of both the application communication libraries and the underlying hardware interconnect solution in order to overcome scalability issues and to enable a more efficient design approach towards Exascale computing. We have suggested a new application programing interface and have demonstrated a 50x improvement of performance and scalability increases.