Semantic metadata generation for large scientific workflows

Authors:
Jihie Kim;Yolanda Gil;Varun Ratnakar
Affiliations:
Information Sciences Institute, University of Southern California, Marina del Rey, CA, United States;Information Sciences Institute, University of Southern California, Marina del Rey, CA, United States;Information Sciences Institute, University of Southern California, Marina del Rey, CA, United States
Venue:
ISWC'06 Proceedings of the 5th international conference on The Semantic Web
Year:
2006

Citing 11
Cited 9

An intelligent assistant for interactive workflow composition

Proceedings of the 9th international conference on Intelligent user interfaces
Filtering and Selecting Semantic Web Services with Interactive Composition Techniques

IEEE Intelligent Systems
A Metadata Catalog Service for Data Intensive Applications

Proceedings of the 2003 ACM/IEEE conference on Supercomputing
Learning domain ontologies for Web service descriptions: an experiment in bioinformatics

WWW '05 Proceedings of the 14th international conference on World Wide Web
Simplifying construction of complex workflows for non-expert users of the Southern California Earthquake Center Community Modeling Environment

ACM SIGMOD Record
A survey of data provenance in e-science

ACM SIGMOD Record
Programming scientific and distributed workflow with Triana services: Research Articles

Concurrency and Computation: Practice & Experience - Workflow in Grid Systems
Automating Experiments Using Semantic Data on a Bioinformatics Grid

IEEE Intelligent Systems
Data complexity of reasoning in very expressive description logics

IJCAI'05 Proceedings of the 19th international joint conference on Artificial intelligence
Using the semantic web for e-science: inspiration, incubation, irritation

ISWC'05 Proceedings of the 4th international conference on The Semantic Web
Provenance-based validation of e-science experiments

ISWC'05 Proceedings of the 4th international conference on The Semantic Web

On the black art of designing computational workflows

Proceedings of the 2nd workshop on Workflows in support of large-scale science
Atomicity and provenance support for pipelined scientific workflows

Future Generation Computer Systems
From data to knowledge to discoveries: Artificial intelligence and scientific workflows

Scientific Programming
Wings for Pegasus: creating large-scale scientific applications using semantic representations of computational workflows

IAAI'07 Proceedings of the 19th national conference on Innovative applications of artificial intelligence - Volume 2
RDFProv: A relational RDF store for querying and managing scientific workflow provenance

Data & Knowledge Engineering
Dependencies between ontology design parameters

International Journal of Metadata, Semantics and Ontologies
Incorporating data provenance in a medical CSCW system

DEXA'10 Proceedings of the 21st international conference on Database and expert systems applications: Part I
Review: interactive knowledge capture in the new millennium: How the semantic web changed everything

The Knowledge Engineering Review
Automatic geospatial metadata generation for earth science virtual data products

Geoinformatica

Quantified Score

Hi-index	0.00

Visualization

Abstract

In recent years, workflows have been increasingly used in scientific applications. This paper presents novel metadata reasoning capabilities that we have developed to support the creation of large workflows. They include 1) use of semantic web technologies in handling metadata constraints on file collections and nested file collections, 2) propagation and validation of metadata constraints from inputs to outputs in a workflow component, and through the links among components in a workflow, and 3) sub-workflows that generate metadata needed for workflow creation. We show how we used these capabilities to support the creation of large executable workflows in an earthquake science application with more than 7,000 jobs, generating metadata for more than 100,000 new files.