Fault localization prioritization: Comparing information-theoretic and coverage-based approaches

Authors:
Shin Yoo;Mark Harman;David Clark
Affiliations:
University College London, UK;University College London, UK;University College London, UK
Venue:
ACM Transactions on Software Engineering and Methodology (TOSEM) - In memoriam, fault detection and localization, formal methods, modeling and design
Year:
2013

Citing 25
Cited 0

Elements of information theory

Elements of information theory
Prioritizing test cases for regression testing

Proceedings of the 2000 ACM SIGSOFT international symposium on Software testing and analysis
Prioritizing Test Cases For Regression Testing

IEEE Transactions on Software Engineering
A history-based test prioritization technique for regression testing in resource constrained environments

Proceedings of the 24th International Conference on Software Engineering
Visualization of test information to assist fault localization

Proceedings of the 24th International Conference on Software Engineering
Measuring Coupling and Cohesion: An Information-Theory Approach

METRICS '99 Proceedings of the 6th International Symposium on Software Metrics
A Comparison of Coverage-Based and Distribution-Based Techniques for Filtering and Prioritizing Test Cases

ISSRE '03 Proceedings of the 14th International Symposium on Software Reliability Engineering
Locating causes of program failures

Proceedings of the 27th international conference on Software engineering
Scalable statistical bug isolation

Proceedings of the 2005 ACM SIGPLAN conference on Programming language design and implementation
Supporting Controlled Experimentation with Testing Techniques: An Infrastructure and its Potential Impact

Empirical Software Engineering
Empirical evaluation of the tarantula automatic fault-localization technique

Proceedings of the 20th IEEE/ACM international Conference on Automated software engineering
Using the Case-Based Ranking Methodology for Test Case Prioritization

ICSM '06 Proceedings of the 22nd IEEE International Conference on Software Maintenance
Search Algorithms for Regression Test Case Prioritization

IEEE Transactions on Software Engineering
On the Accuracy of Spectrum-based Fault Localization

TAICPART-MUTATION '07 Proceedings of the Testing: Academic and Industrial Conference Practice and Research Techniques - MUTATION
An empirical study of the effects of test-suite reduction on fault localization

Proceedings of the 30th international conference on Software engineering
A static analysis for quantifying information flow in a simple imperative language

Journal of Computer Security
On similarity-awareness in testing-based fault localization

Automated Software Engineering
Clustering test cases to achieve effective and scalable prioritisation incorporating expert knowledge

Proceedings of the eighteenth international symposium on Software testing and analysis
How Well Do Test Case Prioritization Techniques Support Statistical Fault Localization

COMPSAC '09 Proceedings of the 2009 33rd Annual IEEE International Computer Software and Applications Conference - Volume 01
Quantifying information flow with beliefs

Journal of Computer Security - 18th IEEE Computer Security Foundations Symposium (CSF 18)
Directed test generation for effective fault localization

Proceedings of the 19th international symposium on Software testing and analysis
Causal inference for statistical fault localization

Proceedings of the 19th international symposium on Software testing and analysis
Studying software evolution using artefacts' shared information content

Science of Computer Programming
Prioritizing tests for software fault diagnosis

Software—Practice & Experience
Regression testing minimization, selection and prioritization: a survey

Software Testing, Verification & Reliability

Quantified Score

Hi-index	0.00

Visualization

Abstract

Test case prioritization techniques seek to maximize early fault detection. Fault localization seeks to use test cases already executed to help find the fault location. There is a natural interplay between the two techniques; once a fault is detected, we often switch focus to fault fixing, for which localization may be a first step. In this article we introduce the Fault Localization Prioritization (FLP) problem, which combines prioritization and localization. We evaluate three techniques: a novel FLP technique based on information theory, FLINT (Fault Localization using INformation Theory), that we introduce in this article, a standard Test Case Prioritization (TCP) technique, and a “test similarity technique” used in previous work. Our evaluation uses five different releases of four software systems. The results indicate that FLP and TCP can statistically significantly reduce fault localization costs for 73% and 76% of cases, respectively, and that FLINT significantly outperforms similarity-based localization techniques in 52% of the cases considered in the study.