Pegasus: A framework for mapping complex scientific workflows onto distributed systems

  • Authors:

  • Ewa Deelman;Gurmeet Singh;Mei-Hui Su;James Blythe;Yolanda Gil;Carl Kesselman;Gaurang Mehta;Karan Vahi;G. Bruce Berriman;John Good;Anastasia Laity;Joseph C. Jacob;Daniel S. Katz

  • Affiliations:

  • University of Southern California Information Sciences Institute, CA, USA;University of Southern California Information Sciences Institute, CA, USA;University of Southern California Information Sciences Institute, CA, USA;University of Southern California Information Sciences Institute, CA, USA;University of Southern California Information Sciences Institute, CA, USA;University of Southern California Information Sciences Institute, CA, USA;University of Southern California Information Sciences Institute, CA, USA;University of Southern California Information Sciences Institute, CA, USA;Infrared Processing and Analysis Center, California Institute of Technology, CA, USA;Infrared Processing and Analysis Center, California Institute of Technology, CA, USA;Infrared Processing and Analysis Center, California Institute of Technology, CA, USA;Jet Propulsion Laboratory, California Institute of Technology, CA, USA;Jet Propulsion Laboratory, California Institute of Technology, CA, USA

  • Venue:
  • Scientific Programming
  • Year:
  • 2005

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper describes the Pegasus framework that can be used to map complex scientific workflows onto distributed resources. Pegasus enables users to represent the workflows at an abstract level without needing to worry about the particulars of the target execution systems. The paper describes general issues in mapping applications and the functionality of Pegasus. We present the results of improving application performance through workflow restructuring which clusters multiple tasks in a workflow into single entities. A real-life astronomy application is used as the basis for the study.