An experimental evaluation of the assumption of independence in multiversion programming
IEEE Transactions on Software Engineering
Evaluation of competing software reliability predictions
IEEE Transactions on Software Engineering - Special issue on reliability and safety in real-time process control
Software reliability: measurement, prediction, application
Software reliability: measurement, prediction, application
Fault Injection for Dependability Validation: A Methodology and Some Applications
IEEE Transactions on Software Engineering
Fault Injection Experiments Using FIAT
IEEE Transactions on Computers
An Experimental Evaluation of Software Redundancy as a Strategy for Improving Reliability
IEEE Transactions on Software Engineering
A Unified Framework for Simulating Markovian Models of Highly Dependable Systems
IEEE Transactions on Computers
FINE: A Fault Injection and Monitoring Environment for Tracing the UNIX System Behavior Under Faults
IEEE Transactions on Software Engineering - Special issue on software reliability
Experimental analysis of computer system dependability
Fault-tolerant computer system design
Software reliability modeling survey
Handbook of software reliability engineering
Handbook of software reliability engineering
Qualitative and Quantitative Reliability Assessment
IEEE Software
Predicting How Badly "Good" Software Can Behave
IEEE Software
The Infeasibility of Quantifying the Reliability of Life-Critical Real-Time Software
IEEE Transactions on Software Engineering
Software Dependability in the Tandem GUARDIAN System
IEEE Transactions on Software Engineering
Engineering Oriented Dependability Evaluation: MEADEP and Its Applications
PRFTS '97 Proceedings of the 1997 Pacific Rim International Symposium on Fault-Tolerant Systems
Sensitivity of reliability growth models to operational profile errors
ISSRE '96 Proceedings of the The Seventh International Symposium on Software Reliability Engineering
Evaluation of Software Dependability Based on Stability Test Data
FTCS '95 Proceedings of the Twenty-Fifth International Symposium on Fault-Tolerant Computing
The N-Version Approach to Fault-Tolerant Software
IEEE Transactions on Software Engineering
Robustness Testing of Java Server Applications
IEEE Transactions on Software Engineering
Hi-index | 0.00 |
Traditional software testing methods combined with probabilistic models cannot measure and assess dependability for software that requires very high reliability (failure rate 0.999999). This paper proposes a novel approach, drawing on findings and methods that have been described individually but have never been combined, applied in the late testing phase or early operational phase, to quantify dependability for a category of critical software with such high requirements. The concepts that are integrated are: operational profile, rare conditions, importance sampling, stress testing, and measurement-based dependability evaluation. In the approach, importance sampling is applied on the operational profile to guide the testing of critical operations of the software, thereby accelerating the occurrence of rare conditions which have been shown to be a leading cause of failure in critical systems. The failure rates measured in the testing are then transformed to those that would occur in the normal operation by the likelihood ratio function of the importance sampling theory, and finally dependability for the tested software system is evaluated by using measurement-based dependability modeling techniques. When the acceleration factor is large (over 100), which is typical for a category of software of interest, it is possible to quantify a very high reliability or availability in a reasonable test duration. Some feasible methods to implement the approach are discussed based on real data.