Using System Emulation to Model Next-Generation Shared Virtual Memory Clusters

  • Authors:

  • Angelos Bilas;Courtney R. Gibson;Reza Azimi;Rosalia Christodoulopoulou;Peter Jamieson

  • Affiliations:

  • Department of Electrical and Computer Engineering, University of Toronto, Toronto, ON, Canada M5S 3G4;Department of Electrical and Computer Engineering, University of Toronto, Toronto, ON, Canada M5S 3G4;Department of Electrical and Computer Engineering, University of Toronto, Toronto, ON, Canada M5S 3G4;Department of Computer Science, University of Toronto, Toronto, ON, Canada M5S 3G4;Department of Electrical and Computer Engineering, University of Toronto, Toronto, ON, Canada M5S 3G4

  • Venue:
  • Cluster Computing
  • Year:
  • 2003

Quantified Score

Hi-index 0.00

Visualization

Abstract

Recently much effort has been spent on providing a shared address space abstraction on clusters of small-scale symmetric multiprocessors. However, advances in technology will soon make it possible to construct these clusters with larger-scale cc-NUMA nodes, connected with non-coherent networks that offer latencies and bandwidth comparable to interconnection networks used in hardware cache-coherent systems. The shared memory abstraction can be provided on these systems in software across nodes and hardware within nodes.Recent simulation results have demonstrated that certain features of modern system area networks can be used to greatly reduce shared virtual memory (SVM) overheads [5,19]. In this work we leverage these results and we use detailed system emulation to investigate building future software shared memory clusters. We use an existing, large-scale hardware cache-coherent system with 64 processors to emulate a complete future cluster. We port our existing infrastructure (communication layer and shared memory protocol) on this system and study the behavior of a set of real applications. We present results for both 32- and 64-processor system configurations.We find that: (i) System emulation is invaluable in quantifying potential benefits from changes in the technology of commodity components. More importantly, it reveals potential problems in future systems that are easily overlooked in simulation studies. Thus, system emulation should be used along with other modeling techniques (e.g., simulation, implementation) to investigate future trends. (ii) Our work shows that current SVM protocols can only partially take advantage of faster interconnects and wider nodes due to operating system and architectural implications. We quantify the related issues and identify the areas where more research is required for future SVM clusters.