Efficient wire formats for high performance computing
Proceedings of the 2000 ACM/IEEE conference on Supercomputing
Investigating the Limits of SOAP Performance for Scientific Computing
HPDC '02 Proceedings of the 11th IEEE International Symposium on High Performance Distributed Computing
Latency Performance of SOAP Implementations
CCGRID '02 Proceedings of the 2nd IEEE/ACM International Symposium on Cluster Computing and the Grid
LYE: A High-Performance Caching SOAP Implementation
ICPP '04 Proceedings of the 2004 International Conference on Parallel Processing
| Hi-index | 0.00 |
Current systems for managing workload on clusters of workstations, particularly those available for Linux-based (Beowulf) clusters, are typically based on traditional process-based, coarse-grained parallel and distributed programming. The DESPOT project is building a sophisticated resource-monitoring and scheduling system for computational, storage and network resources. In this paper we present our enhanced scheduling algorithm within DESPOT, our architecture for low-overhead, fine-grained resource-monitoring tools for per-process network and other resource usage. This algorithm takes into account network, CPU, and memory demands to go beyond simple load balancing for better performance. We also present our architecture for enhancing inter-process communication using the SOAP protocol through the application of multi-level caching. We present experimental results on a small Beowulf cluster showing scheduling performance gains of up to 40%, using the multi-facetted DESPOT algorithm over the MOSIX load-balancing implementation, and SOAP performance gains of up to 600%.