Scalable node allocation for improved performance in regular and anisotropic 3D torus supercomputers

  • Authors:
  • Carl Albing;Norm Troullier;Stephen Whalen;Ryan Olson;Joe Glenski;Howard Pritchard;Hugo Mills

  • Affiliations:
  • University of Reading, Reading, Berkshire, UK and Cray Inc., Saint Paul, MN;Cray Inc., Saint Paul, MN;Cray Inc., Saint Paul, MN and University of Minnesota, Minneapolis, MN;Cray Inc., Saint Paul, MN;Cray Inc., Saint Paul, MN;Cray Inc., Saint Paul, MN;University of Reading, Reading, Berkshire, UK

  • Venue:
  • EuroMPI'11 Proceedings of the 18th European MPI Users' Group conference on Recent advances in the message passing interface
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

MPI application performance can vary based on the scheduler's placing of ranks, whether between nodes or on cores in the same multi-core chip. MPI applications, by default, are at the mercy of the application placement software decision that assigns nodes to a job. We describe herein the general approach of node ordering for allocation in a 3D torus, how it improved MPI application performance, even in the face of an anisotropic interconnect. We demonstrate, quantitatively, that our topologically-based ordering results in improved performance for several MPI applications running on a Top10 supercomputer.