ZEN: A Directive-Based Language for Automatic Experiment Management of Distributed and Parallel Programs

  • Authors:
  • Radu Prodan;Thomas Fahringer

  • Affiliations:
  • -;-

  • Venue:
  • ICPP '02 Proceedings of the 2002 International Conference on Parallel Processing
  • Year:
  • 2002

Quantified Score

Hi-index 0.00

Visualization

Abstract

So far there exists very little support to specify and to control execution of a large number of experiments on distributed and parallel architectures. This paper describes ZEN, a directive-based language for the specification of arbitrarily complex program executions by varying problem, system, or machine parameters for parallel and distributed applications. ZEN introduces directives to substitute strings and to insert assignment statements inside arbitrary files, such as program, input, script, or makefiles. The programmer thus can invoke experiments for arbitrary value ranges of any problem parameter, including program variables, file names, compiler options, target machines, machine sizes, scheduling strategies, data distributions, etc. The number of experiments can be controlled through ZEN constraintdirectives. Finally, the programmer may request a large set of performance metrics to be computed for any code region of interest. The scope of ZEN directives can be restrictedto arbitrary file or code regions. We have implemented a prototype tool for automatic experiment management that is based on ZEN. We will report results for performance analysisof an ocean simulation application and for parameter study of a computational finance code.