Multicore OS benchmarks: we can do better

  • Authors:
  • Ihor Kuz;Zachary Anderson;Pravin Shinde;Timothy Roscoe

  • Affiliations:
  • NICTA and The University of New South Wales, Sydney;Systems Group, Department of Computer Science, ETH Zurich;Microsoft Research PhD Fellowship;Systems Group, Department of Computer Science, ETH Zurich

  • Venue:
  • HotOS'13 Proceedings of the 13th USENIX conference on Hot topics in operating systems
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

Current multicore OS benchmarks do not provide workloads that sufficiently reflect real-world use: they typically run a single application, whereas real workloads consist of multiple concurrent programs. In this paper we show that this lack of mixed workloads leads to benchmarks that do not fully exercise the OS and are therefore inadequate at predicting real-world behavior. This implies that effective multicore OS benchmarks must includemixed workloads, but the main design challenge is choosing an appropriate mix. We present a principled approachwhich treats benchmark design as an optimization problem. Our solution leads to a workload mix that uses as much of a system's resources as possible, while also selecting applications whose performance is most sensitive to the availability of those resources.