Towards a unified fault-detection benchmark

  • Authors:
  • Suzanna Schmeelk

  • Affiliations:
  • ACM Member, New Brunswick, NJ, USA

  • Venue:
  • Proceedings of the 9th ACM SIGPLAN-SIGSOFT workshop on Program analysis for software tools and engineering
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

Developing a unified benchmark to compare and contrast ways to detect faults is an important aspect for the future of fault detection. In this paper, we explore benchmarks used in the evaluation of popular static analysis tools in order to raise awareness for the community to work towards a unified benchmark. Additionally, we introduce an initial design for a bottom-up repository to integrate benchmarks directly with the web interface of the accessible fault taxonomy, the Common Weakness Enumeration (CWE). The repository would be dynamically linked directly into the evolving CWE. It would reflect new faults, new fault attributes, new test cases and test case attributes. The repository could be dynamically used to aggregate, compare, improve and store information about benchmarks.