The impact of synchronization and granularity on parallel systems

  • Authors:
  • Ding-Kai Chen;Hong-Men Su;Pen-Chung Yew

  • Affiliations:
  • Center for Supercomputing Research and Development, University of Illinois at Urbana-Champaign, Urbana, Illinois;Center for Supercomputing Research and Development, University of Illinois at Urbana-Champaign, Urbana, Illinois;Center for Supercomputing Research and Development, University of Illinois at Urbana-Champaign, Urbana, Illinois

  • Venue:
  • ISCA '90 Proceedings of the 17th annual international symposium on Computer Architecture
  • Year:
  • 1990

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper, we study the impact of synchronization and granularity on the performance of parallel systems using an execution-driven simulation technique. We find that even though there can be a lot of parallelism at the fine grain level, synchronization and scheduling strategies determine the ultimate performance of the system. Loop-iteration level parallelism seems to be a more appropriate level when those factors are considered. We also study barrier synchronization and data synchronization at the loop iteration level and found both schemes are needed for a better performance.