Performance Metrics: Keeping the Focus on Runtime

  • Authors:
  • Sartaj Sahni;Venkat Thanvantri

  • Affiliations:
  • -;-

  • Venue:
  • IEEE Parallel & Distributed Technology: Systems & Technology
  • Year:
  • 1996

Quantified Score

Hi-index 0.00

Visualization

Abstract

Parallel computing's much-heralded triumph has failed to arrive with all its anticipated thunder. This disappointing acceptance of parallel computing springs from several reasons, the first three technological and the fourth largely economic: Lack of a unifying model. Parallel computing has no simple, acceptably accurate model whose algorithms run as well on the model as on a real parallel computer. Lack of program portability. To change parallel computers usually requires that users rewrite or at least retune all programs according to a number of features. Lack of suitable performance metrics. Performance metrics for parallel algorithms consequently are tied to the target parallel architecture, and there are as many of these algorithm-architecture combinations as there are different parallel architectures. Use of slow processors. Parallel computers frequently use serial processors that are significantly slower than the fastest PCs and workstations, making it difficult to show spectacular gains over the latest serial competitors. The authors review the various proposed metrics to discover why so many performance metrics for parallel systems currently exist. They then show that while the focus of much recent research has shifted to optimizing performance metrics, runtime should remain the primary measure. Elevating almost any other metric to the primary position runs the risk of favoring a parallel algorithm that always runs slower over one that always runs faster.