An integrated resource management and scheduling system for grid data streaming applications

Authors:
Wen Zhang; Junwei Cao; Yisheng Zhong; Lianchen Liu; Cheng Wu
Affiliations:
Dept. of Autom., Tsinghua Univ., Beijing;Res. Inst. of Inf. Technol., Tsinghua Univ., Beijing;Dept. of Autom., Tsinghua Univ., Beijing;Dept. of Autom., Tsinghua Univ., Beijing;Dept. of Autom., Tsinghua Univ., Beijing
Venue:
GRID '08 Proceedings of the 2008 9th IEEE/ACM International Conference on Grid Computing
Year:
2008

Citing 5
Cited 3

Adaptation in natural and artificial systems

Adaptation in natural and artificial systems
The grid: blueprint for a new computing infrastructure

The grid: blueprint for a new computing infrastructure
GriPhyN and LIGO, Building a Virtual Data Grid for Gravitational Wave Scientists

HPDC '02 Proceedings of the 11th IEEE International Symposium on High Performance Distributed Computing
A static resource allocation framework for Grid-based streaming applications: Research Articles

Concurrency and Computation: Practice & Experience - Middleware for Grid Computing
Scheduling Data-IntensiveWorkflows onto Storage-Constrained Distributed Resources

CCGRID '07 Proceedings of the Seventh IEEE International Symposium on Cluster Computing and the Grid

Block-Based Concurrent and Storage-Aware Data Streaming for Grid Applications with Lots of Small Files

CCGRID '09 Proceedings of the 2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid
Fuzzy Allocation of Fine-Grained Compute Resources for Grid Data Streaming Applications

International Journal of Grid and High Performance Computing
DDS: A deadlock detection-based scheduling algorithm for workflow computations in HPC systems with storage constraints

Parallel Computing

Quantified Score

Hi-index	0.00

Visualization

Abstract

Grid data streaming applications are novel from others in that they require real-time data supply while the processing is going on, which necessitates harmonious collaborations among processors, bandwidth and storage. Traditional scheduling approaches may not be sufficient for such applications, for they usually focus on only one aspect of resources, mainly computational resources. A resource management and scheduling system for such applications is developed in this paper, which is responsible for enabling their running based on Globus toolkit. An integrated scheme is proposed, including admission control, application selecting, processor assigning, allocation of bandwidth and storage, with corresponding algorithms elaborated. Evaluation results show excellent performance and scalability of this system.