Towards fully adaptive pipeline parallelism for heterogeneous distributed environments

  • Authors:
  • Horacio González-Vélez;Murray Cole

  • Affiliations:
  • Institute for Computing Systems Architecture, School of Informatics, University of Edinburgh, Edinburgh, UK;Institute for Computing Systems Architecture, School of Informatics, University of Edinburgh, Edinburgh, UK

  • Venue:
  • ISPA'06 Proceedings of the 4th international conference on Parallel and Distributed Processing and Applications
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

This work describes an adaptive parallel pipeline skeleton which maps pipeline stages to the best processors available in the system and clears dynamically emerging performance bottlenecks at run-time by re-mapping affected stages to other processors. It is implemented in C and MPI and evaluated on a non-dedicated heterogeneous Linux cluster. We report upon the skeleton's ability to respond to an artificially generated variation in the background load across the cluster.