Estimating Bounds on the Reliability of Diverse Systems

  • Authors:
  • Peter Popov;Lorenzo Strigini;John May;Silke Kuball

  • Affiliations:
  • -;-;-;-

  • Venue:
  • IEEE Transactions on Software Engineering
  • Year:
  • 2003

Quantified Score

Hi-index 0.00

Visualization

Abstract

We address the difficult problem of estimating the reliability of multiple-version software. The central issue is the degree of statistical dependence between failures of diverse versions. Previously published models of failure dependence described what behavior could be expected 驴on average驴 from a pair of 驴independently generated驴 versions. We focus instead on predictions using specific information about a given pair of versions. The concept of 驴variation of difficulty驴 between situations to which software may be subject is central to the previous models cited, and it turns out to be central for our question as well. We provide new understanding of various alternative imprecise estimates of system reliability and some results of practical use, especially with diverse systems assembled from pre-existing (e.g., 驴off-the-shelf驴) subsystems. System designers, users, and regulators need useful bounds on the probability of system failure. We discuss how to use reliability data about the individual diverse versions to obtain upper bounds and other useful information for decision making. These bounds are greatly affected by how the versions' probabilities of failure vary between subdomains of the demand space or between operating regimes驴it is even possible in some cases to demonstrate, before operation, upper bounds that are very close to the true probability of failure of the system驴and by the level of detail with which these variations are documented in the data.