Hardware-Assisted Characterization of NAS Benchmarks

  • Authors:
  • W. E. Cohen;R. K. Gaede;W. D. Garrett

  • Affiliations:
  • Red Hat, Inc., 2600 Meridian Pkwy., Durham, NC 27713,USA;Electrical and Computer Engineering Department, University of Alabama in Huntsville, Huntsville, AL 35899, USA;Mitre Corporation, 1500 Perimeter Pkwy., Suite 310, Huntsville, AL 35806, USA

  • Venue:
  • Cluster Computing
  • Year:
  • 2001

Quantified Score

Hi-index 0.00

Visualization

Abstract

The UAH Logging, Trace Recording, and Analysis instrumentation (ULTRA) provides highly repeatable (0.0002% variation) application instruction counts for parallel programs which are invariant to the communication network used, the number of processors used, and the MPI communication library used. ULTRA, implemented as an MPI profiling wrapper, avoids the data collection system artifacts of time-based measurements by using instruction counts as the basic measure of work performed and records the operation performed and the amount of data sent for each network operation. These measurements can be scaled appropriately for various target architectures. ULTRA's instrumentation overhead is minimized by using the Pentium II processors's performance monitoring hardware, allowing large, production-run applications to be quickly characterized. Traces of the NAS benchmarks representing 6.67×1012 application instructions were generated by ULTRA. The application instructions executed per byte injected into the network and the instructions executed per message sent were computed from the traces. These values can be scaled by the expected processor performance to estimate the minimum network performance required to support the programs. It is impossible to use time-based measurements for this purpose due to measurement artifacts caused by the background processes and the communication network of the data collection system.