An adaptive meta-scheduler for data-intensive applications

  • Authors:
  • Hai Jin;Xuanhua Shi;Weizhong Qiang;Deqing Zou

  • Affiliations:
  • Cluster and Grid Computing Lab, Huazhong University of Science and Technology, Wuhan 430074, China.;Cluster and Grid Computing Lab, Huazhong University of Science and Technology, Wuhan 430074, China.;Cluster and Grid Computing Lab, Huazhong University of Science and Technology, Wuhan 430074, China.;Cluster and Grid Computing Lab, Huazhong University of Science and Technology, Wuhan 430074, China

  • Venue:
  • International Journal of Grid and Utility Computing
  • Year:
  • 2005

Quantified Score

Hi-index 0.00

Visualization

Abstract

In data-intensive applications, such as high-energy physics, bio-informatics, we encounter applications involving numerous jobs that access and generate large datasets. Effective scheduling of such applications is a challenge, due to the need to consider for both computational resources and data storage resources. In this paper, we describe an adaptive scheduling model that considers availability of computational, storage and network resources. Based on this model we implement a scheduler used in our campus grid. The results achieved by our scheduler have been analysed by comparing with greedy algorithm that is widely used in computational grids and some data grids.