A Communication Staging Technique for Network Cache Interconnected Clusters

  • Authors:
  • Amy W. Apon;Hsiang Ann Chen;Charlotte F. Fischer;Larry E. Wilbur

  • Affiliations:
  • -;-;-;-

  • Venue:
  • IWCC '99 Proceedings of the 1st IEEE Computer Society International Workshop on Cluster Computing
  • Year:
  • 1999

Quantified Score

Hi-index 0.00

Visualization

Abstract

This work is an experimental investigation of a technique for staging communication between tasks of parallel applications in clusters that are interconnected with network cache architecture. With network cache a process can write broadcast data to a shared buffer on the NIC. This data is immediately broadcast on the network and available in shared buffers on the NIC's of all workstations. By using network cache as a large staging area for collective communications, the required number of data and synchronization messages is reduced and application performance is improved. A version of matrix-vector multiply in which the result vector is available to all processes at the end of the computation is implemented both using network cache and using traditional MPI messaging libraries. The implementations are compared experimentally, and results show that completion time is improved by several factors with network cache staging rather than the point-to-point implementation of MPI messaging libraries.