GridWorkflow: A Flexible Failure Handling Framework for the Grid

• Authors: Soonwook Hwang;Carl Kesselman
• Venue: HPDC '03 Proceedings of the 12th IEEE International Symposium on High Performance Distributed Computing
• Year: 2003

The generic, heterogeneous, and dynamic nature of the Grid requires a new form of failure recovery mechanism to address its unique requirements such as support for diverse failure handling strategies, separation of failure handling strategies from application codes, and user-defined exception handling. We here propose a Grid Workflow System (Grid-WFS), a flexible failure handling framework for the Grid, which addresses these Grid-unique failure recovery requirements. Central to the framework is flexibility in handing failures. We describe how to achieve the flexibility by the use of workflow structure as a high-level recovery policy specification. We show how this use of high-level workflow structure allows users to achieve failure recovery in a variety of ways depending on the requirements and constraints of their applications. We also demonstrate that this use of workflow structure enables users to not only rapidly prototype and investigate failure handling strategies, but also easily change them by simply modifying the encompassing workflow structure, while the application code remainsintact. Finally, we present an experimental evaluation of our framework using a simulation, demonstrating the value of supporting multiple failure recovery techniques in Grid systems to achieve high performance in the presence of failures.