Using Workflow Medleys to Streamline Exploratory Tasks

Authors:
Emanuele Santos;David Koop;Huy T. Vo;Erik W. Anderson;Juliana Freire;Cláudio Silva
Affiliations:
Scientific Computing and Imaging Institute, University of Utah, Salt Lake City, USA and School of Computing, University of Utah, Salt Lake City, USA;Scientific Computing and Imaging Institute, University of Utah, Salt Lake City, USA and School of Computing, University of Utah, Salt Lake City, USA;Scientific Computing and Imaging Institute, University of Utah, Salt Lake City, USA and School of Computing, University of Utah, Salt Lake City, USA;Scientific Computing and Imaging Institute, University of Utah, Salt Lake City, USA and School of Computing, University of Utah, Salt Lake City, USA;School of Computing, University of Utah, Salt Lake City, USA;Scientific Computing and Imaging Institute, University of Utah, Salt Lake City, USA and School of Computing, University of Utah, Salt Lake City, USA
Venue:
SSDBM 2009 Proceedings of the 21st International Conference on Scientific and Statistical Database Management
Year:
2009

Citing 8
Cited 3

SCIRun: a scientific programming environment for computational steering

Supercomputing '95 Proceedings of the 1995 ACM/IEEE conference on Supercomputing
Workflow management: models, methods, and systems

Workflow management: models, methods, and systems
Machine Learning

Machine Learning
Chimera: AVirtual Data System for Representing, Querying, and Automating Data Derivation

SSDBM '02 Proceedings of the 14th International Conference on Scientific and Statistical Database Management
Pegasus: A framework for mapping complex scientific workflows onto distributed systems

Scientific Programming
ManyEyes: a Site for Visualization at Internet Scale

IEEE Transactions on Visualization and Computer Graphics
Zoom*UserViews: querying relevant provenance in workflow systems

VLDB '07 Proceedings of the 33rd international conference on Very large data bases
Managing rapidly-evolving scientific workflows

IPAW'06 Proceedings of the 2006 international conference on Provenance and Annotation of Data

Provenance management for data exploration

DILS'10 Proceedings of the 7th international conference on Data integration in the life sciences
RECYCLE: Learning looping workflows from annotated traces

ACM Transactions on Intelligent Systems and Technology (TIST)
A process-centric data mining and visual analytic tool for exploring complex social networks

Proceedings of the ACM SIGKDD Workshop on Interactive Data Exploration and Analytics

Quantified Score

Hi-index	0.00

Visualization

Abstract

To analyze and understand the growing wealth of scientific data, complex workflows need to be assembled, often requiring the combination of loosely-coupled resources, specialized libraries, distributed computing infrastructure, and Web services. However, constructing these workflows is a non-trivial task, especially for users who do not have programming expertise. This problem is compounded for exploratory tasks, where the workflows need to be iteratively refined. In this paper, we introduce workflow medleys , a new approach for manipulating collections of workflows. We propose a workflow manipulation language that includes operations that are common in exploratory tasks and present a visual interface designed for this language. We briefly discuss how medleys have been applied in two (real) applications.