Issues in computer performance evaluation: some consensus, some divergence

  • Authors:
  • B. W. Boehm;T. E. Bell

  • Affiliations:
  • -;-

  • Venue:
  • ACM SIGMETRICS Performance Evaluation Review
  • Year:
  • 1975

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper summarizes the results of an ACM/NBS Workshop on Computer Performance Evaluation. Computer Performance Evaluation (CPE) was selected as the subject of an ACM/NBS Workshop because of the significant leverage CPE activities can have on computer usage. This paper describes a number of conclusions abstracted from the discussions as well as presenting recommendations formally adopted by the participants. While several of these conclusions indicate that improvements are needed in performance analysis tools, another suggests that improved application of CPE could be achieved by better documentation of analysis approaches. More integration of data collection and modeling are considered necessary for the performance analysis field to develop its full potential. Participants noted that the common emphasis on data collection or modeling, to the exclusion of considering objectives, often seriously degrades the value of performance analyses; the only savings that really count from a performance analysis are the ones that appear on the bottom line of the balance sheet.