Design and implementation of a one-sided communication interface for the IBM eServer Blue Gene® supercomputer

Authors:
M. Blocksome;C. Archer;T. Inglett;P. McCarthy;M. Mundy;J. Ratterman;A. Sidelnik;B. Smith;G. Almási;J. Castaños;D. Lieber;J. Moreira;S. Krishnamoorthy;V. Tipparaju;J. Nieplocha
Affiliations:
IBM Systems Group, Rochester, MN;IBM Systems Group, Rochester, MN;IBM Systems Group, Rochester, MN;IBM Systems Group, Rochester, MN;IBM Systems Group, Rochester, MN;IBM Systems Group, Rochester, MN;IBM Systems Group, Rochester, MN;IBM Systems Group, Rochester, MN;IBM Thomas JWatson Research Center, Yorktown Heights, NY;IBM Thomas JWatson Research Center, Yorktown Heights, NY;IBM Thomas JWatson Research Center, Yorktown Heights, NY;IBM Thomas JWatson Research Center, Yorktown Heights, NY;Dreese Laboratories, Columbus, OH;Pacific Northwest National Laboratory, Richland, WA;Pacific Northwest National Laboratory, Richland, WA
Venue:
Proceedings of the 2006 ACM/IEEE conference on Supercomputing
Year:
2006

Citing 7
Cited 5

Global arrays: a nonuniform memory access programming model for high-performance computers

The Journal of Supercomputing
A high-performance, portable implementation of the MPI message passing interface standard

Parallel Computing
ARMCI: A Portable Remote Memory Copy Libray for Ditributed Array Libraries and Compiler Run-Time Systems

Proceedings of the 11 IPPS/SPDP'99 Workshops Held in Conjunction with the 13th International Parallel Processing Symposium and 10th Symposium on Parallel and Distributed Processing
An overview of the BlueGene/L Supercomputer

Proceedings of the 2002 ACM/IEEE conference on Supercomputing
Generalized portable shmem library for high performance computing

Generalized portable shmem library for high performance computing
Blue Gene: a vision for protein science using a petaflop supercomputer

IBM Systems Journal - Deep computing for the life sciences
High Performance Remote Memory Access Communication: The Armci Approach

International Journal of High Performance Computing Applications

Fine-grained parallelization of the Car-Parrinello ab initio molecular dynamics method on the IBM Blue Gene/L supercomputer

IBM Journal of Research and Development
Scalable molecular dynamics with NAMD on the IBM Blue Gene/L system

IBM Journal of Research and Development
Exploiting 162-Nanosecond End-to-End Communication Latency on Anton

Proceedings of the 2010 ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis
A cluster computer performance predictor for memory scheduling

ICA3PP'11 Proceedings of the 11th international conference on Algorithms and architectures for parallel processing - Volume Part II
A cost-effective heuristic to schedule local and remote memory in cluster computers

The Journal of Supercomputing

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper discusses the design and implementation of a one-sided communication interface for the IBM Blue Gene/L supercomputer. This interface facilitates ARMCI and the Global Arrays toolkit and can be used by other one-sided communication libraries. New protocols, interrupt driven communication, and compute node kernel enhancements were required to enable these libraries. Three possible methods for enabling ARMCI on the Blue Gene/L software stack are discussed. A detailed look into the development process shows how the implementation of the one-sided communication interface was completed. This was accomplished on a compressed time scale with the collaboration of various organizations within IBM and open source communities. In addition to enabling the one-sided libraries, bandwidth enhancements were made for communication along a diagonal on the Blue Gene/L torus network. The maximum bandwidth improved by a factor of three. This work will enable a variety of one-sided applications to run on Blue Gene/L.