Software quality metrics: considerations about requirements and requirement specifications
Information and Software Technology - Software quality assurance
Automated analysis of requirement specifications
ICSE '97 Proceedings of the 19th international conference on Software engineering
Experimentation in software engineering: an introduction
Experimentation in software engineering: an introduction
Modern Information Retrieval
Recovering documentation-to-source-code traceability links using latent semantic indexing
Proceedings of the 25th International Conference on Software Engineering
Information Retrieval Models for Recovering Traceability Links between Code and Documentation
ICSM '00 Proceedings of the International Conference on Software Maintenance (ICSM'00)
Supporting Software Evolution through Dynamically Retrieving Traces to UML Artifacts
IWPSE '04 Proceedings of the Principles of Software Evolution, 7th International Workshop
Advancing Candidate Link Generation for Requirements Tracing: The Study of Methods
IEEE Transactions on Software Engineering
ACM Transactions on Software Engineering and Methodology (TOSEM)
Assessing IR-based traceability recovery tools through controlled experiments
Empirical Software Engineering
Improving automated requirements trace retrieval: a study of term-based enhancement methods
Empirical Software Engineering
Software traceability with topic modeling
Proceedings of the 32nd ACM/IEEE International Conference on Software Engineering - Volume 1
A machine learning approach for tracing regulatory codes to product specific requirements
Proceedings of the 32nd ACM/IEEE International Conference on Software Engineering - Volume 1
On the Equivalence of Information Retrieval Methods for Automated Traceability Link Recovery
ICPC '10 Proceedings of the 2010 IEEE 18th International Conference on Program Comprehension
Extraction and visualization of traceability relationships between documents and source code
Proceedings of the IEEE/ACM international conference on Automated software engineering
COMPSAC '10 Proceedings of the 2010 IEEE 34th Annual Computer Software and Applications Conference
Automated Requirements Traceability: The Study of Human Analysts
RE '10 Proceedings of the 2010 18th IEEE International Requirements Engineering Conference
Towards scalable information modeling of requirements architectures
ER'12 Proceedings of the 2012 international conference on Advances in Conceptual Modeling
| Hi-index | 0.00 |
Large-scale software development generates an ever-growing amount of information. Multiple research groups have proposed using approaches from the domain of information retrieval (IR) to recover traceability. Several enhancement strategies have been initially explored using the laboratory model of IR evaluation for performance assessment. We conducted a pilot experiment using printed candidate lists from the tools RETRO and ReqSimile to investigate how different quality levels of tool output affect the tracing accuracy of engineers. Statistical testing of equivalence, commonly used in medicine, has been conducted to analyze the data. The low number of subjects in this pilot experiment resulted neither in statistically significant equivalence nor difference. While our results are not conclusive, there are indications that it is worthwhile to investigate further into the actual value of improving tool support for semi-automatic traceability recovery. For example, our pilot experiment showed that the effect size of using RETRO versus ReqSimile is of practical significance regarding precision and F-measure. The interpretation of the effect size regarding recall is less clear. The experiment needs to be replicated with more subjects and on varying tasks to draw firm conclusions.