Tuning parallel applications in parallel

  • Authors:
  • Ananta Tiwari;Vahid Tabatabaee;Jeffrey K. Hollingsworth

  • Affiliations:
  • Department of Computer Science, University of Maryland, College Park, MD 20742, United States;Department of Computer Science, University of Maryland, College Park, MD 20742, United States;Department of Computer Science, University of Maryland, College Park, MD 20742, United States

  • Venue:
  • Parallel Computing
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper, we present and evaluate a parallel algorithm for parameter tuning of parallel applications. We discuss the impact of performance variability on the accuracy and efficiency of the optimization algorithm and propose a strategy to minimize the impact of this variability. We evaluate our algorithm within the Active Harmony system, an automated online/offline tuning framework. We study its performance on three benchmark codes: PSTSWM, HPL and POP. Compared to the Nelder-Mead algorithm, our algorithm finds better configurations up to seven times faster. For POP, we were able to improve the performance of a production sized run by 59%.