A dynamic job grouping-based scheduling for deploying applications with fine-grained tasks on global grids

Authors:
Nithiapidary Muthuvelu;Junyang Liu;Nay Lin Soe;Srikumar Venugopal;Anthony Sulistio;Rajkumar Buyya
Affiliations:
The University of Melbourne, Australia;The University of Melbourne, Australia;The University of Melbourne, Australia;The University of Melbourne, Australia;The University of Melbourne, Australia;The University of Melbourne, Australia
Venue:
ACSW Frontiers '05 Proceedings of the 2005 Australasian workshop on Grid computing and e-research - Volume 44
Year:
2005

Citing 7
Cited 8

The grid: blueprint for a new computing infrastructure

The grid: blueprint for a new computing infrastructure
Partitioning and Scheduling Parallel Programs for Multiprocessors

Partitioning and Scheduling Parallel Programs for Multiprocessors
DSC: Scheduling Parallel Tasks on an Unbounded Number of Processors

IEEE Transactions on Parallel and Distributed Systems
A computational economy for grid computing and its implementation in the Nimrod-G resource broker

Future Generation Computer Systems - Grid computing: Towards a new computing infrastructure
GLB: A Low-Cost Scheduling Algorithm for Distributed-Memory Architectures

HIPC '98 Proceedings of the Fifth International Conference on High Performance Computing
Grid Computing: Making the Global Infrastructure a Reality

Grid Computing: Making the Global Infrastructure a Reality
Neuroscience instrumentation and distributed analysis of brain activity data: a case for eScience on global Grids: Research Articles

Concurrency and Computation: Practice & Experience

DAGMap: Efficient scheduling for DAG grid workflow job

GRID '08 Proceedings of the 2008 9th IEEE/ACM International Conference on Grid Computing
A dependency based bandwidth aware dynamic job grouping grid scheduler with deadline based network-ToS

PDCS '07 Proceedings of the 19th IASTED International Conference on Parallel and Distributed Computing and Systems
Adaptive checkpointing strategy to tolerate faults in economy based grid

The Journal of Supercomputing
DAGMap: efficient and dependable scheduling of DAG workflow job in Grid

The Journal of Supercomputing
Dynamic Job-Clustering with Different Computing Priorities for Computational Resource Allocation

CCGRID '10 Proceedings of the 2010 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing
A job grouping approach for planning container transfers at automated seaport container terminals

Advanced Engineering Informatics
On-Line task granularity adaptation for dynamic grid applications

ICA3PP'10 Proceedings of the 10th international conference on Algorithms and Architectures for Parallel Processing - Volume Part I
On-Line, non-clairvoyant optimization of workflow activity granularity on grids

Euro-Par'13 Proceedings of the 19th international conference on Parallel Processing

Quantified Score

Hi-index	0.00

Visualization

Abstract

Although Grids have been used extensively for executing applications with compute-intensive jobs, there exist several applications with a large number of lightweight jobs. The overall processing undertaking of these applications involves high overhead time and cost in terms of (i) job transmission to and from Grid resources and, (ii) job processing at the Grid resources. Therefore, there is a need for an efficient job grouping-based scheduling system to dynamically assemble the individual fine-grained jobs of an application into a group of jobs, and send these coarse-grained jobs to the Grid resources. This dynamic grouping should be done based on the processing requirements of each application, Grid resources' availability and their processing capability.In this paper, we present a scheduling strategy that performs dynamic job grouping activity at runtime and convey the detailed analysis by running simulations. In addition, job processing granularity size is introduced to facilitate the job grouping activity in determining the total amount of jobs that can be processed in a resource within a specified time.