Datagridflows: managing long-run processes on datagrids

  • Authors:

  • Arun Jagatheesan;Jonathan Weinberg;Reena Mathew;Allen Ding;Erik Vandekieft;Daniel Moore;Reagan Moore;Lucas Gilbert;Mark Tran;Jeffrey Kuramoto

  • Affiliations:

  • San Diego Supercomputer Center, University of California, San Diego, La Jolla, CA;San Diego Supercomputer Center, University of California, San Diego, La Jolla, CA;San Diego Supercomputer Center, University of California, San Diego, La Jolla, CA;San Diego Supercomputer Center, University of California, San Diego, La Jolla, CA;San Diego Supercomputer Center, University of California, San Diego, La Jolla, CA;San Diego Supercomputer Center, University of California, San Diego, La Jolla, CA;San Diego Supercomputer Center, University of California, San Diego, La Jolla, CA;San Diego Supercomputer Center, University of California, San Diego, La Jolla, CA;San Diego Supercomputer Center, University of California, San Diego, La Jolla, CA;San Diego Supercomputer Center, University of California, San Diego, La Jolla, CA

  • Venue:
  • DMG 2005 Proceedings of the First VLDB conference on Data Management in Grids
  • Year:
  • 2005

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper is an introduction to Datagridflows. Until recently, datagrids were generally considered over-hyped and the associated technologies not widely embraced in the academic community. Today, datagrids have become a reality and an important technology for managing large, unstructured data and storage resources distributed over autonomous administrative domains. The datagrids that are operating in production provide us an idea of new requirements and challenges that will be faced in future datagrid environments. One such requirement is the coordinated execution of long-run data management processes in datagrids. We term these processes as “datagridflows”. This new area provides exciting opportunities and challenges to researchers in distributed computing and distributed databases. This paper is intended to introduce these challenges to other researchers, including those new to grid computing. We provide motivation through discussion of datagridflow requirements and real production scenarios. We introduce current work on datagridflow technologies including the Datagrid Language (DGL) for describing datagridflows in datagrids.