An experimental evaluation of the assumption of independence in multiversion programming
IEEE Transactions on Software Engineering
Conceptual Modeling of Coincident Failures in Multiversion Software
IEEE Transactions on Software Engineering
Modeling of Correlated Failures and Community Error Recovery in Multiversion Software
IEEE Transactions on Software Engineering
Dependability Modeling and Evaluation of Software Fault-Tolerant Systems
IEEE Transactions on Computers
An Experimental Evaluation of Software Redundancy as a Strategy for Improving Reliability
IEEE Transactions on Software Engineering
Estimating the Probability of Failure When Testing Reveals No Failures
IEEE Transactions on Software Engineering
Estimation and Enhancement of Real-Time Software Reliability Through Mutation Analysis
IEEE Transactions on Computers - Special issue on fault-tolerant computing
Validation of ultrahigh dependability for software-based systems
Communications of the ACM
Measurement-based analysis of software reliability
Handbook of software reliability engineering
Software Fault Tolerance
Software Reliability Engineering: A Roadmap
FOSE '07 2007 Future of Software Engineering
Managing redundancy in CAN-based networks supporting N-Version Programming
Computer Standards & Interfaces
The effect of correlated failure rates on reliability of continuous time 1-out-of-2 software
SAFECOMP'11 Proceedings of the 30th international conference on Computer safety, reliability, and security
Finding upper bounds for software failure probabilities – experiments and results
SAFECOMP'05 Proceedings of the 24th international conference on Computer Safety, Reliability, and Security
Hi-index | 0.00 |
We address the difficult problem of estimating the reliability of multiple-version software. The central issue is the degree of statistical dependence between failures of diverse versions. Previously published models of failure dependence described what behavior could be expected 驴on average驴 from a pair of 驴independently generated驴 versions. We focus instead on predictions using specific information about a given pair of versions. The concept of 驴variation of difficulty驴 between situations to which software may be subject is central to the previous models cited, and it turns out to be central for our question as well. We provide new understanding of various alternative imprecise estimates of system reliability and some results of practical use, especially with diverse systems assembled from pre-existing (e.g., 驴off-the-shelf驴) subsystems. System designers, users, and regulators need useful bounds on the probability of system failure. We discuss how to use reliability data about the individual diverse versions to obtain upper bounds and other useful information for decision making. These bounds are greatly affected by how the versions' probabilities of failure vary between subdomains of the demand space or between operating regimes驴it is even possible in some cases to demonstrate, before operation, upper bounds that are very close to the true probability of failure of the system驴and by the level of detail with which these variations are documented in the data.