Towards Reliable, Performant Workflows for Streaming-Applications on Cloud Platforms

  • Authors:
  • Daniel Zinn;Quinn Hart;Timothy McPhillips;Bertram Ludascher;Yogesh Simmhan;Michail Giakkoupis;Viktor K. Prasanna

  • Affiliations:
  • -;-;-;-;-;-;-

  • Venue:
  • CCGRID '11 Proceedings of the 2011 11th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

Scientific workflows are commonplace in eScience applications. Yet, the lack of integrated support for data models, including streaming data, structured collections and files, is limiting the ability of workflows to support emerging applications in energy informatics that are stream oriented. This is compounded by the absence of Cloud data services that support reliable and performant streams. In this paper, we propose and present a scientific workflow framework that supports streams as first-class data, and is optimized for performant and reliable execution across desktop and Cloud platforms. The workflow framework features and its empirical evaluation on a private Eucalyptus cloud are presented.