Observation Inaccuracy in Conformance Testing with Multiple Testers

  • Authors:
  • Y. -C. Young;K. -C. Tai

  • Affiliations:
  • -;-

  • Venue:
  • ASSET '98 Proceedings of the 1998 IEEE Workshop on Application - Specific Software Engineering and Technology
  • Year:
  • 1998

Quantified Score

Hi-index 0.00

Visualization

Abstract

In conformance testing of a software system, independent multiple testers (or observers) are often used, each providing input messages to and receiving output messages from the software system. For an execution of the software system, if all testers have observed correct results, the intuitive conclusion is that this execution is correct. However, this conclusion may be wrong, and this problem is referred to as multi-tester observation inaccuracy. In this paper, for a specification written as a deterministic or nondeterministic finite state machine (FSM), we present a necessary and sufficient condition for an incorrect test observation by multiple testers. For a specification written as a deterministic FSM, we define three types of implementation faults that can cause incorrect test observations. We also propose a strategy for solving the problem of multi-tester observation inaccuracy.