An MPI prototype for compiled communication on Ethernet switched clusters

  • Authors:
  • Amit Karwande;Xin Yuan;David K. Lowenthal

  • Affiliations:
  • Department of Computer Science, Florida State University, Tallahassee, FL 32306, USA;Department of Computer Science, Florida State University, Tallahassee, FL 32306, USA;Department of Computer Science, University of Georgia, Athen, GA 30602, USA

  • Venue:
  • Journal of Parallel and Distributed Computing - Special issue: Design and performance of networks for super-, cluster-, and grid-computing: Part I
  • Year:
  • 2005

Quantified Score

Hi-index 0.00

Visualization

Abstract

Compiled communication has recently been proposed to improve communication performance for clusters of workstations. The idea of compiled communication is to apply more aggressive optimizations to communications whose information is known at compile time. Existing MPI libraries do not support compiled communication. In this paper, we present an MPI prototype, CC-MPI, that supports compiled communication on Ethernet switched clusters. The unique feature of CC-MPI is that it allows the user to manage network resources such as multicast groups directly and to optimize communications based on the availability of the communication information. CC-MPI optimizes one-to-all, one-to-many, all-to-all, and many-to-many collective communication routines using the compiled communication technique. We describe the techniques used in CC-MPI and report its performance.The results show that communication performance of Ethernet switched clusters can be significantly improved through compiled communication.