Benchmarking workflow discovery: a case study from bioinformatics

  • Authors:
  • Antoon Goderis;Paul Fisher;Andrew Gibson;Franck Tanoh;Katy Wolstencroft;David De Roure;Carole Goble, Professor

  • Affiliations:
  • School of Computer Science, The University of Manchester, Manchester M13 9PL, U.K.;School of Computer Science, The University of Manchester, Manchester M13 9PL, U.K.;School of Computer Science, The University of Manchester, Manchester M13 9PL, U.K. and Swammerdam Institute for Life Sciences, Universiteit van Amsterdam, Amsterdam, The Netherlands;School of Computer Science, The University of Manchester, Manchester M13 9PL, U.K.;School of Computer Science, The University of Manchester, Manchester M13 9PL, U.K.;School of Electronics and Computer Science, University of Southampton, Southampton SO17 1BJ, U.K.;School of Computer Science, The University of Manchester, Manchester M13 9PL, U.K.

  • Venue:
  • Concurrency and Computation: Practice & Experience - Special Issue: 3rd International Workshop on Workflow Management and Applications in Grid Environments (WaGe2008)
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

Automation in science is increasingly marked by the use of workflow technology. The sharing of workflows through repositories supports the verifiability, reproducibility and extensibility of computational experiments. However, the subsequent discovery of workflows remains a challenge, both from a sociological and technological viewpoint. Based on a survey with participants from 19 laboratories, we investigate the current practices in workflow sharing, re-use and discovery among life scientists chiefly using the Taverna workflow management system. To address their perceived lack of effective workflow discovery tools, we go on to develop benchmarks for the evaluation of discovery tools, drawing on a series of practical exercises. We demonstrate the value of the benchmarks on two tools: one using graph matching and the other relying on text clustering. Copyright © 2009 John Wiley & Sons, Ltd.