Performance degradation due to multiprogramming and system overheads in real workloads: case study on a shared memory multiprocessor

Authors:
R. T. Dimpsey;R. K. Iyer
Affiliations:
Center for Reliable and High-Performance Computing, University of Illinois at Urbana-Champaign, 1101 W. Springfield Ave., Urbana, IL;Center for Reliable and High-Performance Computing, University of Illinois at Urbana-Champaign, 1101 W. Springfield Ave., Urbana, IL
Venue:
ICS '90 Proceedings of the 4th international conference on Supercomputing
Year:
1990

Citing 0
Cited 8

Parallel programs and background load: efficiency studies with the PAR-Bench system

ICS '91 Proceedings of the 5th international conference on Supercomputing
Performance prediction and tuning on a multiprocessor

ISCA '91 Proceedings of the 18th annual international symposium on Computer architecture
Evaluating performance of prefetching second level caches

ACM SIGMETRICS Performance Evaluation Review
Parallelism in a multi-user environment

Parallel Computing
Paper: Benchmarking parallel programs in a multiprogramming environment: The PAR-bench system

Parallel Computing
On the value of preemption in scheduling

APPROX'06/RANDOM'06 Proceedings of the 9th international conference on Approximation Algorithms for Combinatorial Optimization Problems, and 10th international conference on Randomization and Computation
Non-preemptive speed scaling

SWAT'12 Proceedings of the 13th Scandinavian conference on Algorithm Theory
Non-preemptive speed scaling

Journal of Scheduling

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper, performance degradation specifically due to the multiprogramming (MP) overhead in a parallel execution environment is quantified. In addition, total system overhead is also measured. A methodology, which estimates the MP overhead present in real workloads, is illustrated with real measurements taken on an Alliant FX/80 running Xylem (Cedar's operating system). It is found that MP overhead usually consumes between 10% and 23% of the processing power available to parallel programs. Total system overhead usually consumes between 12% and 30% of the parallel environment processing power, but is found to be as high as 82.1%. The mean MP overhead is determined to be 16% which is well over half the total system overhead executed on the system (the mean system overhead is determined to be 24% of the processing power). It is found that MP overhead, total system overhead, and application completion time are all moderately correlated. Relationships between the characteristics of a workload and the overhead measurements indicate that processor utilization and to a lesser degree paging are moderately correlated with the overhead present in the workload. It is also found that MP overhead is statistically independent of the number of parallel jobs in the system, while total system overhead is not.