Information Processing Letters
Evaluation of safety-critical software
Communications of the ACM
Measures of testability as a basis for quality assurance
Software Engineering Journal
Partition Testing Does Not Inspire Confidence (Program Testing)
IEEE Transactions on Software Engineering
Testability of Software Components
IEEE Transactions on Software Engineering
Estimating the Probability of Failure When Testing Reveals No Failures
IEEE Transactions on Software Engineering
PIE: A Dynamic Failure-Based Technique
IEEE Transactions on Software Engineering
Faults on its sleeve: amplifying software reliability testing
ISSTA '93 Proceedings of the 1993 ACM SIGSOFT international symposium on Software testing and analysis
Validation of ultrahigh dependability for software-based systems
Communications of the ACM
Are We Testing for True Reliability?
IEEE Software
Operational Profiles in Software-Reliability Engineering
IEEE Software
Software Testability: The New Verification
IEEE Software
The Effect of Imperfect Error Detection on Reliability Assessment via Life Testing
IEEE Transactions on Software Engineering
A Critique of Software Defect Prediction Models
IEEE Transactions on Software Engineering
Testability, fault size and the domain-to-range ratio: An eternal triangle
Proceedings of the 2000 ACM SIGSOFT international symposium on Software testing and analysis
The ability of directed tests to predict software quality
Annals of Software Engineering
Software testability measurement for intelligent assertion placement
Software Quality Control
Critical Analysis of the PIE Testability Technique
Software Quality Control
On reducing the sensitivity of software reliability to variations in the operational profile
ISSRE '96 Proceedings of the The Seventh International Symposium on Software Reliability Engineering
Testing Nondeterminate Systems
ISSRE '00 Proceedings of the 11th International Symposium on Software Reliability Engineering
Assessment methodologies for public contractors
ACM SIGSOFT Software Engineering Notes
Journal of Systems and Software - Special issue: Applications of statistics in software engineering
A new approach for software testability analysis
Proceedings of the 28th international conference on Software engineering
COOTS'96 Proceedings of the 2nd conference on USENIX Conference on Object-Oriented Technologies (COOTS) - Volume 2
Composition and tradeoff of non-functional attributes in software systems: research directions
Proceedings of the the 6th joint meeting of the European software engineering conference and the ACM SIGSOFT symposium on The foundations of software engineering
Composition and tradeoff of non-functional attributes in software systems: research directions
The 6th Joint Meeting on European software engineering conference and the ACM SIGSOFT symposium on the foundations of software engineering: companion papers
An optimization framework for "build-or-buy" decisions in software architecture
Computers and Operations Research
A probability-based approach for measuring external attributes of software artifacts
ESEM '09 Proceedings of the 2009 3rd International Symposium on Empirical Software Engineering and Measurement
A survey of component based system quality assurance and assessment
Information and Software Technology
Software testing research and practice
ASM'03 Proceedings of the abstract state machines 10th international conference on Advances in theory and practice
A new approach for software testability
TAIC PART'10 Proceedings of the 5th international academic and industrial conference on Testing - practice and research techniques
A component testability model for verification and measurement
COMPSAC-W'05 Proceedings of the 29th annual international conference on Computer software and applications conference
An empirical analysis of a testability model for object-oriented programs
ACM SIGSOFT Software Engineering Notes
A diagnostic reasoning approach to defect prediction
IEA/AIE'11 Proceedings of the 24th international conference on Industrial engineering and other applications of applied intelligent systems conference on Modern approaches in applied intelligence - Volume Part II
Evaluating the effect of control flow on the unit testing effort of classes: an empirical analysis
Advances in Software Engineering
Hi-index | 0.00 |
Program "testability" is, informally, the probability that a program will fail under test if it contains at least one fault. When a dependability assessment has to be derived from the observation of a series of failure-free test executions (a common need for software subject to "ultra-high reliability" requirements), measures of testability can驴in theory驴be used to draw inferences on program correctness (and hence on its probability of failure in operation). In this paper, we rigorously investigate the concept of testability and its use in dependability assessment, criticizing, and improving on, previously published results.We first give a general descriptive model of program execution and testing, on which the different measures of interest can be defined. We propose a more precise definition of program testability than that given by other authors, and discuss how to increase testing effectiveness without impairing program reliability in operation. We then study the mathematics of using testability to estimate, from test results: 1) the probability of program correctness and 2) the probability of failures. To derive the probability of program correctness, we use a Bayesian inference procedure and argue that this is more useful than deriving a classical "confidence level." We also show that a high testability is not an unconditionally desirable property for a program. In particular, for programs complex enough that they are unlikely to be completely fault-free, increasing testability may produce a program which will be less trustworthy, even after successful testing.