Symbiotic space-sharing on SDSC's datastar system

  • Authors:

  • Jonathan Weinberg;Allan Snavely

  • Affiliations:

  • San Diego Supercomputer Center, University of California, San Diego, La Jolla, CA;San Diego Supercomputer Center, University of California, San Diego, La Jolla, CA

  • Venue:
  • JSSPP'06 Proceedings of the 12th international conference on Job scheduling strategies for parallel processing
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

Using a large HPC platform, we investigate the effectiveness of "symbiotic space-sharing", a technique that improves system throughput by executing parallel applications in combinations and configurations that alleviate pressure on shared resources. We demonstrate that relevant benchmarks commonly suffer a 10-60% penalty in runtime efficiency due to memory resource bottlenecks and up to several orders of magnitude for I/O. We show that this penalty can be often mitigated, and sometimes virtually eliminated, by symbiotic space-sharing techniques and deploy a prototype scheduler that leverages these findings to improve system throughput by 20%.