Characterizing the Performance of Parallel Applications on Multi-socket Virtual Machines

Authors:
Khaled Z. Ibrahim;Steven Hofmeyr;Costin Iancu
Affiliations:
-;-;-
Venue:
CCGRID '11 Proceedings of the 2011 11th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing
Year:
2011

Citing 0
Cited 4

Optimized pre-copy live migration for memory intensive applications

Proceedings of 2011 International Conference for High Performance Computing, Networking, Storage and Analysis
Evaluating virtual router performance for a pluralist future internet

Proceedings of the 3rd International Conference on Information and Communication Systems
Dynamic adaptive virtual core mapping to improve power, energy, and performance in multi-socket multicores

Proceedings of the 21st international symposium on High-Performance Parallel and Distributed Computing
A comparative study of high-performance computing on the cloud

Proceedings of the 22nd international symposium on High-performance parallel and distributed computing

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper we characterize the behavior with respect to memory locality management of scientific computing applications running in virtualized environments. NUMA locality on current solutions (KVM and Xen) is enforced by pinning virtual machines to CPUs and providing NUMA aware allocation in hyper visors. Our analysis shows that due to two-level memory management and lack of integration with page reclamation mechanisms, applications running on warm VMs suffer from a ``leakage'' of page locality. Our results using MPI, UPC and Open MP implementations of the NAS Parallel Benchmarks, running on Intel and AMD NUMA systems, indicate that applications observe an overall average performance degradation of 55\% when compared to native. Runs on ``cold'' VMs suffer an average performance degradation of 27\%, while subsequent runs are roughly 30\% slower than the cold runs. We quantify the impact of locality improvement techniques designed for full virtualization environments: hyper visor level page remapping and partitioning the NUMA domains between multiple virtual machines. Our analysis shows that hyper visor only schemes have little or no potential for performance improvement. When the programming model allows it, system partitioning with proper VM and runtime support is able to re-produce native performance: in a partitioned system with one virtual machine per socket the average workload performance is 5\% better than native.