Computational reproducibility: state-of-the-art, challenges, and database research opportunities

  • Authors:

  • Juliana Freire;Philippe Bonnet;Dennis Shasha

  • Affiliations:

  • New York University, Poly, Brooklyn, NY, USA;IT University of Copenhagen, Copenhagen, Denmark;New York University, New York, USA

  • Venue:
  • SIGMOD '12 Proceedings of the 2012 ACM SIGMOD International Conference on Management of Data
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

Computational experiments have become an integral part of the scientific method, but reproducing, archiving, and querying them is still a challenge. The first barrier to a wider adoption is the fact that it is hard both for authors to derive a compendium that encapsulates all the components needed to reproduce a result and for reviewers to verify the results. In this tutorial, we will present a series of guidelines and, through hands-on examples, review existing tools to help authors create of reproducible results. We will also outline open problems and new directions for database-related research having to do with querying computational experiments.