Indirect cube: A power-efficient topology for compute clusters

Authors:
Javier Navaridas;José Miguel-Alonso
Affiliations:
School of Computer Science, The University of Manchester, Oxford Road, Manchester M13 9PL, UK;Computer Architecture and Technology Department, The University of the Basque Country UPV/EHU, P. Manuel de Lardizabal 1, 20018 San Sebastián, Spain
Venue:
Optical Switching and Networking
Year:
2011

Citing 10
Cited 0

The cosmic cube

Communications of the ACM - Special section on computer architecture
Gigabit Ethernet Networking

Gigabit Ethernet Networking
The adaptive bubble router

Journal of Parallel and Distributed Computing
Myrinet: A Gigabit-per-Second Local Area Network

IEEE Micro
k -ary n -trees: High Performance Networks for Massively Parallel Architectures

IPPS '97 Proceedings of the 11th International Symposium on Parallel Processing
Improving the performance of large interconnection networks using congestion-control mechanisms

Performance Evaluation
Cray XT4: an early evaluation for petascale scientific simulation

Proceedings of the 2007 ACM/IEEE conference on Supercomputing
Exploring pattern-aware routing in generalized fat tree networks

Proceedings of the 23rd international conference on Supercomputing
Realistic Evaluation of Interconnection Networks Using Synthetic Traffic

ISPDC '09 Proceedings of the 2009 Eighth International Symposium on Parallel and Distributed Computing
Reducing complexity in tree-like computer interconnection networks

Parallel Computing

Quantified Score

Hi-index	0.00

Visualization

Abstract

Interconnection networks arranged as k-ary n-trees or spines are widely used to build high-performance computing clusters. Current blade-based technology allows the integration of the first level of the network together with the compute elements. The remaining network stages require dedicated rack space. In most systems one or several racks house the upper network stages, separated from the compute elements. This incurs significant additional costs, especially if a rack containing only a few switches has to be added. In this paper we propose and evaluate the performance and power-consumption of an alternative arrangement that connects elements in a cube-like topology. Building an indirect cube topology requires only the use of the switches that are integrated within the compute elements and also simplifies deployment. We explore a wide variety of system scales, ranging from 120 to 7680 compute nodes, in order to find out to which size the proposed topology can scale while keeping adequate performance levels and low power demands. An additional advantage of our proposal is that the same equipment can be reused to form a tree-based topology if a performance boost is needed.