BlackjackBench: portable hardware characterization

  • Authors:
  • Anthony Danalis;Piotr Luszczek;Gabriel Marin;Jeffrey S. Vetter;Jack Dongarra

  • Affiliations:
  • University of Tennessee, Knoxville, TN, USA;University of Tennessee, Knoxville, TN, USA;Oak Ridge National Lab., Oak Ridge, TN, USA;Oak Ridge National Lab., Oak Ridge, TN, USA;University of Tennessee, Knoxville, TN, USA

  • Venue:
  • ACM SIGMETRICS Performance Evaluation Review
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

DARPA's AACE project aimed to develop Architecture Aware Compiler Environments that automatically characterizes the hardware and optimizes the application codes accordingly. We present the BlackjackBench -- a suite of portable benchmarks that automate system characterization, plus statistical analysis techniques for interpreting the results. The BlackjackBench discovers the effective sizes and speeds of the hardware environment rather than the often unattainable peak values. We aim at hardware characteristics that can be observed by running standard C codes. We characterize the memory hierarchy, including cache sharing and NUMA characteristics of the system, properties of the processing cores affecting instruction execution speed, and the length of the OS scheduler time slot. We show how they all could potentially interfere with each other and how established classification and statistical analysis techniques reduce experimental noise and aid automatic interpretation of results.