Implementing global memory management in a workstation cluster
SOSP '95 Proceedings of the fifteenth ACM symposium on Operating systems principles
The MOSIX multicomputer operating system for high performance cluster computing
Future Generation Computer Systems - Special issue on HPCN '97
ACM Computing Surveys (CSUR)
The Network RamDisk: Using remote memory on heterogeneous NOWs
Cluster Computing
Out-of-core construction and visualization of multiresolution surfaces
I3D '03 Proceedings of the 2003 symposium on Interactive 3D graphics
Cashmere-VLM: Remote Memory Paging for Software Distributed Shared Memory
IPPS '99/SPDP '99 Proceedings of the 13th International Symposium on Parallel Processing and the 10th Symposium on Parallel and Distributed Processing
My Cache or Yours? Making Storage More Exclusive
ATEC '02 Proceedings of the General Track of the annual conference on USENIX Annual Technical Conference
Cooperative Caching Middleware for Cluster-Based Servers
HPDC '01 Proceedings of the 10th IEEE International Symposium on High Performance Distributed Computing
Xen and the art of virtualization
SOSP '03 Proceedings of the nineteenth ACM symposium on Operating systems principles
FTDCS '04 Proceedings of the 10th IEEE International Workshop on Future Trends of Distributed Computing Systems
Implementing transparent shared memory on clusters using virtual machines
ATEC '05 Proceedings of the annual conference on USENIX Annual Technical Conference
Live migration of virtual machines
NSDI'05 Proceedings of the 2nd conference on Symposium on Networked Systems Design & Implementation - Volume 2
Implementation of a reliable remote memory pager
ATEC '96 Proceedings of the 1996 annual conference on USENIX Annual Technical Conference
Distributed anemone: transparent low-latency access to remote memory
HiPC'06 Proceedings of the 13th international conference on High Performance Computing
Post-copy based live virtual machine migration using adaptive pre-paging and dynamic self-ballooning
Proceedings of the 2009 ACM SIGPLAN/SIGOPS international conference on Virtual execution environments
Proceedings of the 3rd ACM Workshop on System-level Virtualization for High Performance Computing
Post-copy live migration of virtual machines
ACM SIGOPS Operating Systems Review
Overdriver: handling memory overload in an oversubscribed cloud
Proceedings of the 7th ACM SIGPLAN/SIGOPS international conference on Virtual execution environments
| Hi-index | 0.00 |
Modern grid computing and enterprise applications increasingly execute on clusters that rely upon virtual machines (VMs) to partition hardware resources and improve utilization efficiency. These applications tend to have memory and I/O intensive workloads, such as large databases, data mining, scientific workloads, and web services, which can strain the limited I/O and memory resources within a single VM. In this paper, we present our experiences in developing a fully transparent distributed system, called MemX, within the Xen VM environment that coordinates the use of cluster-wide memory resources to support large memory and I/O intensive workloads. Applications using MemX do not require specialized APIs, libraries, recompilation, relinking, or dataset pre-partitioning. We compare and contrast the different design choices in MemX and present preliminary performance evaluation using several resource-intensive benchmarks in both virtualized and non-virtualized Linux. Our evaluations show that large dataset applications and multiple concurrent VMs achieve significant speedups using MemX compared against virtualized local and iSCSI disks. As an added benefit, we also show that live Xen VMs using MemX can migrate seamlessly without disrupting any running applications.