Fast Scalable File Distribution Over Infiniband

  • Authors:
  • Dennis Dalessandro;Pete Wyckoff

  • Affiliations:
  • Ohio Supercomputer Center;Ohio Supercomputer Center

  • Venue:
  • IPDPS '05 Proceedings of the 19th IEEE International Parallel and Distributed Processing Symposium (IPDPS'05) - Workshop 18 - Volume 19
  • Year:
  • 2005

Quantified Score

Hi-index 0.00

Visualization

Abstract

One of the first steps in starting a program on a cluster is to get the executable, which generally resides on some network file server. This creates not only contention on the network, but causes unnecessary strain on the network file system as well, which is busy serving other requests at the same time. This approach is certainly not scalable as clusters grow larger. We present a new approach that uses a high speed interconnect, novel network features, and a scalable design. We provide a fast, efficient, and scalable solution to the distribution of executable files on production parallel machines.