Traceability challenge 2011: using TraceLab to evaluate the impact of local versus global IDF on trace retrieval

Authors:
Adam Czauderna;Marek Gibiec;Greg Leach;Yubin Li;Yonghee Shin;Ed Keenan;Jane Cleland-Huang
Affiliations:
DePaul University, Chicago, IL, USA;DePaul University, Chicago, IL, USA;DePaul University, Chicago, IL, USA;DePaul University, Chicago, IL, USA;DePaul University, Chicago, IL, USA;DePaul University, Chicago, IL, USA;DePaul University, Chicago, IL, USA
Venue:
Proceedings of the 6th International Workshop on Traceability in Emerging Forms of Software Engineering
Year:
2011

Citing 5
Cited 2

Automatic text processing: the transformation, analysis, and retrieval of information by computer

Automatic text processing: the transformation, analysis, and retrieval of information by computer
Recovering Traceability Links between Code and Documentation

IEEE Transactions on Software Engineering
Helping Analysts Trace Requirements: An Objective Look

RE '04 Proceedings of the Requirements Engineering Conference, 12th IEEE International
Best Practices for Automated Traceability

Computer
On the Equivalence of Information Retrieval Methods for Automated Traceability Link Recovery

ICPC '10 Proceedings of the 2010 IEEE 18th International Conference on Program Comprehension

TraceLab: an experimental workbench for equipping researchers to innovate, synthesize, and comparatively evaluate traceability solutions

Proceedings of the 34th International Conference on Software Engineering
Improving trace accuracy through data-driven configuration and composition of tracing features

Proceedings of the 2013 9th Joint Meeting on Foundations of Software Engineering

Quantified Score

Hi-index	0.00

Visualization

Abstract

Numerous trace retrieval algorithms incorporate the standard tf-idf (term frequency, inverse document frequency) technique to weight various terms. In this paper we address Grand Challenge C-GC1 by comparing the effectiveness of computing idf based only on the local terms in the query, versus computing it based on general term usage as documented in the American National Corpus. We also address Grand Challenges L-GC1 and L-GC2 by setting ourselves the additional task of designing and conducting the experiments using the alpha-release of TraceLab. TraceLab is an experimental workbench which allows researchers to graphically model and execute a traceability experiment as a workflow of components. Results of the experiment show that the local idf approach exceeds or matches the global approach in all of the cases studied.