Making the non-executable ACATS tests executable

  • Authors:
  • Dan R. Eilers;Tero Koskinen

  • Affiliations:
  • Irvine Compiler Corp., Irvine, CA, USA;n/a, n/a, Finland

  • Venue:
  • SIGAda '11 Proceedings of the 2011 ACM annual international conference on Special interest group on the ada programming language
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

The Ada Conformity Assessment Test Suite (ACATS) includes both positive and negative tests. The negative tests have intentional errors that a compiler is intended to diagnose with a compile-time error message. Interestingly, the negative tests also include numerous "OK" lines that the compiler must not reject. But the absence of an error message on the "OK" lines is not always a convincing demonstration that the "OK" lines were correctly compiled, since the negative tests are not executable. By removing the intentional errors from a copy of each negative test, we are able to compile and run the resulting modified tests, demonstrating more convincingly that the "OK" lines are correctly compiled.