Data Processing Workflow Automation in Grid Architecture

  • Authors:
  • Zhichun Xiao;Craig W. Thompson;Wing Ning Li

  • Affiliations:
  • Acxiom Corporation, USA;University of Arkansas, USA;University of Arkansas, USA

  • Venue:
  • GCCW '06 Proceedings of the Fifth International Conference on Grid and Cooperative Computing Workshops
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

Because of the poor performance and the expensive license cost, traditional relational database management systems are no longer good choices for processing huge amount of data. Grid computing is replacing the place of RDBMS in data processing. Traditionally a workflow is generated by data experts, which is time consuming, labor intensive and error prone. More over, it becomes the bottleneck of the overall performance of data processing in the grid architecture. This paper proposes a multi-layer workflow automation strategy that can automatically generate a workflow from a business language. A prototype has been implemented and a simulation has been designed.