A Comparison of Two Methods for Building Astronomical Image Mosaics on a Grid

Authors:
Daniel S. Katz;Joseph C. Jacob;G. Bruce Berriman;John Good;Anastasia C. Laity;Ewa Deelman;Carl Kesselman;Gurmeet Singh
Affiliations:
California Institute of Technology;California Institute of Technology;California Institute of Technology;California Institute of Technology;California Institute of Technology;University of Southern California;University of Southern California;University of Southern California
Venue:
ICPPW '05 Proceedings of the 2005 International Conference on Parallel Processing Workshops
Year:
2005

Citing 0
Cited 15

A provisioning model and its comparison with best-effort for performance-cost optimization in grids

Proceedings of the 16th international symposium on High performance distributed computing
On the black art of designing computational workflows

Proceedings of the 2nd workshop on Workflows in support of large-scale science
Analysis of application heartbeats: learning structural and temporal features in time series data for identification of performance problems

Proceedings of the 2008 ACM/IEEE conference on Supercomputing
Adaptive pricing for resource reservations in Shared environments

GRID '07 Proceedings of the 8th IEEE/ACM International Conference on Grid Computing
Resource co-allocation for large-scale distributed environments

Proceedings of the 18th ACM international symposium on High performance distributed computing
Montage: a grid portal and software toolkit for science-grade astronomical image mosaicking

International Journal of Computational Science and Engineering
Grid-enabled ensemble subsurface modeling

PDCS '07 Proceedings of the 19th IASTED International Conference on Parallel and Distributed Computing and Systems
Experiences with resource provisioning for scientific workflows using Corral

Scientific Programming
Middleware support for many-task computing

Cluster Computing
Data Sharing Options for Scientific Workflows on Amazon EC2

Proceedings of the 2010 ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis
AME: an anyscale many-task computing engine

Proceedings of the 6th workshop on Workflows in support of large-scale science
An Evaluation of the Cost and Performance of Scientific Workflows on Amazon EC2

Journal of Grid Computing
Design and analysis of data management in scalable parallel scripting

SC '12 Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis
MTC envelope: defining the capability of large scale computers in the context of parallel scripting applications

Proceedings of the 22nd international symposium on High-performance parallel and distributed computing
A Case Study into Using Common Real-Time Workflow Monitoring Infrastructure for Scientific Workflows

Journal of Grid Computing

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper compares two methods for running an application composed of a set of modules on a grid. The set of modules (collectively called Montage) generates large astronomical image mosaics by composing multiple small images. The workflow that describes a particular run of Montage can be expressed as a directed acyclic graph (DAG), or as a short sequence of parallel (MPI) and sequential programs. In the first case, Pegasus can be used to run the workflow. In the second case, a short shell script that calls each program can be run. In this paper, we discuss the Montage modules, the workflow run for a sample job, and the two methods of actually running the workflow. We examine the run time for each method and compare the portions that differ between the two methods.