Predictability of Process Resource Usage: A Measurement-Based Study on UNIX
IEEE Transactions on Software Engineering
On the self-similar nature of Ethernet traffic (extended version)
IEEE/ACM Transactions on Networking (TON)
The Nexus approach to integrating multithreading and communication
Journal of Parallel and Distributed Computing - Special issue on multithreading for multiprocessors
Managing multiple communication methods in high-performance networked computing systems
Journal of Parallel and Distributed Computing - Special issue on workstation clusters and network-based computing
Application-level scheduling on distributed heterogeneous networks
Supercomputing '96 Proceedings of the 1996 ACM/IEEE conference on Supercomputing
Scheduling From the Perspective of the Application
HPDC '96 Proceedings of the 5th IEEE International Symposium on High Performance Distributed Computing
Modeling the Effects of Contention on the Performance of Heterogeneous Applications
HPDC '96 Proceedings of the 5th IEEE International Symposium on High Performance Distributed Computing
Forecasting network performance to support dynamic scheduling using the network weather service
HPDC '97 Proceedings of the 6th IEEE International Symposium on High Performance Distributed Computing
Legion: The Next Logical Step Toward a Nationwide Virtual Computer
Legion: The Next Logical Step Toward a Nationwide Virtual Computer
Application level scheduling of gene sequence comparison on metacomputers
ICS '98 Proceedings of the 12th international conference on Supercomputing
Automatic node selection for high performance applications on networks
Proceedings of the seventh ACM SIGPLAN symposium on Principles and practice of parallel programming
Design Issues of Network Enabled Server Systems for the Grid
GRID '00 Proceedings of the First IEEE/ACM International Workshop on Grid Computing
Characterizing NAS Benchmark Performance on Shared Heterogeneous Networks
IPDPS '02 Proceedings of the 16th International Parallel and Distributed Processing Symposium
CIS - A Monitoring System for PC Clusters
Proceedings of the 7th European PVM/MPI Users' Group Meeting on Recent Advances in Parallel Virtual Machine and Message Passing Interface
The Telescience Portal for advanced tomography applications
Journal of Parallel and Distributed Computing - Special issue on computational grids
Quality of service in an information economy
ACM Transactions on Internet Technology (TOIT)
Mesh generation and optimistic computation on the grid
Performance analysis and grid computing
Automatic Construction and Evaluation of Performance Skeletons
IPDPS '05 Proceedings of the 19th IEEE International Parallel and Distributed Processing Symposium (IPDPS'05) - Papers - Volume 01
Performance Evaluation Model for Scheduling in Global Computing Systems
International Journal of High Performance Computing Applications
Information Collection Services for QoS-Aware Mobile Applications
IEEE Transactions on Mobile Computing
G-lambda: coordination of a grid scheduler and lambda path service over GMPLS
Future Generation Computer Systems - IGrid 2005: The global lambda integrated facility
Scientific Programming
A Scalable and Efficient Self-Organizing Failure Detector for Grid Applications
GRID '05 Proceedings of the 6th IEEE/ACM International Workshop on Grid Computing
Performance of a GridFTP overlay network
Future Generation Computer Systems
Performance prediction with skeletons
Cluster Computing
Time Jails: A Hybrid Approach to Scalable Network Emulation
Proceedings of the 22nd Workshop on Principles of Advanced and Distributed Simulation
A framework for adaptive collective communications for heterogeneous hierarchical computing systems
Journal of Computer and System Sciences
Adaptive approaches for efficient parallel algorithms on cluster-based systems
International Journal of Grid and Utility Computing
A GridFTP Overlay Network Service
GRID '06 Proceedings of the 7th IEEE/ACM International Conference on Grid Computing
Task-execution scheduling schemes for network measurement and monitoring
Computer Communications
Emotions: the voice of the unconscious
ICEC'10 Proceedings of the 9th international conference on Entertainment computing
Task profiling model for load profile prediction
Future Generation Computer Systems
A CUDA programming toolkit on grids
International Journal of Grid and Utility Computing
PROTEUS: network performance forecast for real-time, interactive mobile applications
Proceeding of the 11th annual international conference on Mobile systems, applications, and services
Hi-index | 0.00 |
In this paper we describe the design and implementation of a system called the Network Weather Service (NWS) that takes periodic measurements of deliverable resource performance from distributed networked resources, and uses numerical models to dynamically generate forecasts of future performance levels. These performance forecasts, along with measures of performance fluctuation (e.g. the mean square prediction error) and forecast lifetime that the NWS generates, are made available to schedulers and other resource management mechanisms at runtime so that they may determine the quality-of-service that will be available from each resource.We describe the architecture of the NWS and implementations that we have developed and are currently deploying for the Legion [13] and Globus/Nexus [7] metacomputing infrastructures. We also detail NWS forecasts of resource performance using both the Legion and Globus/Nexus implementations. Our results show that simple forecasting techniques substantially outperform measurements of current conditions (commonly used to gauge resource availability and load) in terms of prediction accuracy. In addition, the techniques we have employed are almost as accurate as substantially more complex modeling methods. We compare our techniques to a sophisticated time-series analysis system in terms of forecasting accuracy and computational complexity.