On the effectiveness of run-time checks

Authors:
Meine J. P. van der Meulen;Lorenzo Strigini;Miguel A. Revilla
Affiliations:
Centre for Software Reliability, City University, London, UK;Centre for Software Reliability, City University, London, UK;University of Valladolid, Valladolid, Spain
Venue:
SAFECOMP'05 Proceedings of the 24th international conference on Computer Safety, Reliability, and Security
Year:
2005

Citing 9
Cited 1

The Use of Self Checks and Voting in Software Error Detection: An Empirical Study

IEEE Transactions on Software Engineering
Software reliability via run-time result-checking

Journal of the ACM (JACM)
Fault Tolerance: Principles and Practice

Fault Tolerance: Principles and Practice
Applying "Design by Contract"

Computer
Reducing Critical Failures for Control Algorithms Using Executable Assertions and Best Effort Recover

DSN '01 Proceedings of the 2001 International Conference on Dependable Systems and Networks (formerly: FTCS)
The Reliability of Diverse Systems: A Contribution Using Modelling of the Fault Creation Process

DSN '01 Proceedings of the 2001 International Conference on Dependable Systems and Networks (formerly: FTCS)
Experimental evaluation of the fail-silent behaviour in programs with consistency checks

FTCS '96 Proceedings of the The Twenty-Sixth Annual International Symposium on Fault-Tolerant Computing (FTCS '96)
An Exploration of Software Faults and Failure Behaviour in a Large Population of Programs

ISSRE '04 Proceedings of the 15th International Symposium on Software Reliability Engineering
The effectiveness of choice of programming language as a diversity seeking decision

EDCC'05 Proceedings of the 5th European conference on Dependable Computing

Experiences with the design of a run-time check

SAFECOMP'06 Proceedings of the 25th international conference on Computer Safety, Reliability, and Security

Quantified Score

Hi-index	0.00

Visualization

Abstract

Run-time checks are often assumed to be a cost-effective way of improving the dependability of software components, by checking required properties of their outputs and flagging an output as incorrect if it fails the check. However, evaluating how effective they are going to be in a future application is difficult, since the effectiveness of a check depends on the unknown faults of the program to which it is applied. A programming contest, providing thousands of programs written to the same specifications, gives us the opportunity to systematically test run-time checks to observe statistics of their effects on actual programs. In these examples, run-time checks turn out to be most effective for unreliable programs. For more reliable programs, the benefit is relatively low as compared to the gain that can be achieved by other (more expensive) measures, most notably multiple-version diversity.