Assessing IR-based traceability recovery tools through controlled experiments

  • Authors:
  • Andrea De Lucia;Rocco Oliveto;Genoveffa Tortora

  • Affiliations:
  • Department of Mathematics and Informatics, University of Salerno, Fisciano (SA), Italy 84084;Department of Mathematics and Informatics, University of Salerno, Fisciano (SA), Italy 84084;Department of Mathematics and Informatics, University of Salerno, Fisciano (SA), Italy 84084

  • Venue:
  • Empirical Software Engineering
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

We report the results of a controlled experiment and a replication performed with different subjects, in which we assessed the usefulness of an Information Retrieval-based traceability recovery tool during the traceability link identification process. The main result achieved in the two experiments is that the use of a traceability recovery tool significantly reduces the time spent by the software engineer with respect to manual tracing. Replication with different subjects allowed us to investigate if subjects' experience and ability play any role in the traceability link identification process. In particular, we made some observations concerning the retrieval accuracy achieved by the software engineers with and without the tool support and with different levels of experience and ability.