Software safety: why, what, and how
ACM Computing Surveys (CSUR)
An experimental evaluation of the assumption of independence in multiversion programming
IEEE Transactions on Software Engineering
Evaluation of competing software reliability predictions
IEEE Transactions on Software Engineering - Special issue on reliability and safety in real-time process control
Fault-Tolerant SoFtware Reliability Modeling
IEEE Transactions on Software Engineering
An Empirical Comparison of Software Fault Tolerance and Fault Elimination
IEEE Transactions on Software Engineering
A reply to the criticisms of the Knight & Leveson experiment
ACM SIGSOFT Software Engineering Notes
Testing a safety-critical application
ISSTA '94 Proceedings of the 1994 ACM SIGSOFT international symposium on Software testing and analysis
Optimal Test Distributions for Software Failure Cost Estimation
IEEE Transactions on Software Engineering
Next generation air traffic control automation
IBM Systems Journal
Toward better software automation
ACM SIGSOFT Software Engineering Notes
ISSTA '96 Proceedings of the 1996 ACM SIGSOFT international symposium on Software testing and analysis
A reliability model combining representative and directed testing
Proceedings of the 18th international conference on Software engineering
Reflections on the Pentium Division Bug
IEEE Transactions on Computers
Choosing a testing method to deliver reliability
ICSE '97 Proceedings of the 19th international conference on Software engineering
Software reliability via run-time result-checking
Journal of the ACM (JACM)
Evaluating Testing Methods by Delivered Reliability
IEEE Transactions on Software Engineering
Formal Methods Technology Transfer: A View from NASA
Formal Methods in System Design - Special issue: industrial critical systems
Generation of Execution Sequences for Modular Time Critical Systems
IEEE Transactions on Software Engineering
Software engineering for safety: a roadmap
Proceedings of the Conference on The Future of Software Engineering
On subdomains: Testing, profiles, and components
Proceedings of the 2000 ACM SIGSOFT international symposium on Software testing and analysis
Comparison of delivered reliability of branch, data flow and operational testing: A case study
Proceedings of the 2000 ACM SIGSOFT international symposium on Software testing and analysis
Communications of the ACM
Theory of software reliability based on components
ICSE '01 Proceedings of the 23rd International Conference on Software Engineering
An efficient set of software degree programs for one domain
ICSE '01 Proceedings of the 23rd International Conference on Software Engineering
Continuity in software systems
ISSTA '02 Proceedings of the 2002 ACM SIGSOFT international symposium on Software testing and analysis
Dependability of embedded systems
Proceedings of the 24th International Conference on Software Engineering
Industrial strength exception freedom
Proceedings of the 2002 annual ACM SIGAda international conference on Ada: The engineering of correct and reliable software for real-time & distributed systems using Ada and related technologies
Applying data redundancy to differential equation solvers
Annals of Software Engineering
Modeling reliability growth during non-representative
Annals of Software Engineering
Relational programs: An architecture for robust real-time safety-critical process-control systems
Annals of Software Engineering
Automated Software Engineering
A Model of Code Sharing for Estimating Software Failure on Demand Probabilities
IEEE Transactions on Software Engineering
Logic versus Magic in Critical Systems
Ada Europe '01 Proceedings of the 6th Ade-Europe International Conference Leuven on Reliable Software Technologies
Software Challenges in Aviation Systems
SAFECOMP '02 Proceedings of the 21st International Conference on Computer Safety, Reliability and Security
Defect-Based Reliability Analysis for Mission-Critical Software
COMPSAC '00 24th International Computer Software and Applications Conference
Computing systems dependability
Proceedings of the 25th International Conference on Software Engineering
Reliability Prediction of a Trajectory Verification System
ASSET '98 Proceedings of the 1998 IEEE Workshop on Application - Specific Software Engineering and Technology
Reliability and Risk Analysis for Software that Must be Safe
METRICS '96 Proceedings of the 3rd International Symposium on Software Metrics: From Measurement to Empirical Results
Software Reliability Corroboration
SEW '02 Proceedings of the 27th Annual NASA Goddard Software Engineering Workshop (SEW-27'02)
Assessing Software Reliability Performance Under Highly Critical But Infrequent Event Occurrences
ISSRE '97 Proceedings of the Eighth International Symposium on Software Reliability Engineering
An Approach to Measuring and Assessing Dependability for Critical Software Systems
ISSRE '97 Proceedings of the Eighth International Symposium on Software Reliability Engineering
Static verification and extreme programming
Proceedings of the 2003 annual ACM SIGAda international conference on Ada: the engineering of correct and reliable software for real-time & distributed systems using ada and related technologies
An Introduction to Computing System Dependability
Proceedings of the 26th International Conference on Software Engineering
A new type of security and safety architecture for distributed system: models and implementation
InfoSecu '04 Proceedings of the 3rd international conference on Information security
Echo: a practical approach to formal verification
Proceedings of the 10th international workshop on Formal methods for industrial critical systems
Verifying Time Partitioning in the DEOS Scheduling Kernel
Formal Methods in System Design
The echo approach to formal verification
Proceedings of the 28th international conference on Software engineering
Formal specification and refinement of a safe train control function
Formal methods for embedded distributed systems
When only random testing will do
Proceedings of the 1st international workshop on Random testing
Subdomain testing of units and systems with state
Proceedings of the 2006 international symposium on Software testing and analysis
On proof-test intervals for safety functions implemented in software
SCS '06 Proceedings of the eleventh Australian workshop on Safety critical systems and software - Volume 69
Estimating web services reliability: a semantic approach
International Journal of Information Systems and Change Management
Journal of Systems and Software
Formal Verification by Reverse Synthesis
SAFECOMP '08 Proceedings of the 27th international conference on Computer Safety, Reliability, and Security
The epistemology of computer security
ACM SIGSOFT Software Engineering Notes
Symbiosis of static analysis and program testing
FASE'03 Proceedings of the 6th international conference on Fundamental approaches to software engineering
Evidence-based validation and improvement of electronic health record systems
Proceedings of the FSE/SDP workshop on Future of software engineering research
Estimation of reliability and cost relationship for architecture-based software
International Journal of Automation and Computing
Dependable computing: concepts, limits, challenges
FTCS'95 Proceedings of the Twenty-Fifth international conference on Fault-tolerant computing
Synthesizing a specification-based monitor for safety requirements
Iranian Journal of Science and Technology, Transaction B: Engineering
Autonomous and dependable recovery scheme in UPnP network settings
IDEAL'05 Proceedings of the 6th international conference on Intelligent Data Engineering and Automated Learning
Towards dependable swarms and a new discipline of swarm engineering
SAB'04 Proceedings of the 2004 international conference on Swarm Robotics
Software reliability assessment based on the evaluation of operational experience
MMB&DFT'10 Proceedings of the 15th international GI/ITG conference on Measurement, Modelling, and Evaluation of Computing Systems and Dependability and Fault Tolerance
Why programming languages still matter
Rigorous Development of Complex Fault-Tolerant Systems
Survey: Linear Temporal Logic Symbolic Model Checking
Computer Science Review
Runtime verification for ultra-critical systems
RV'11 Proceedings of the Second international conference on Runtime verification
Safety demonstration and software development
SAFECOMP'07 Proceedings of the 26th international conference on Computer Safety, Reliability, and Security
Copilot: monitoring embedded systems
Innovations in Systems and Software Engineering
Runtime verification of microcontroller binary code
Science of Computer Programming
| Hi-index | 0.02 |
This work affirms that the quantification of life-critical software reliability is infeasible using statistical methods, whether these methods are applied to standard software or fault-tolerant software. The classical methods of estimating reliability are shown to lead to exorbitant amounts of testing when applied to life-critical software. Reliability growth models are examined and also shown to be incapable of overcoming the need for excessive amounts of testing. The key assumption of software fault tolerance-separately programmed versions fail independently-is shown to be problematic. This assumption cannot be justified by experimentation in the ultrareliability region, and subjective arguments in its favor are not sufficiently strong to justify it as an axiom. Also, the implications of the recent multiversion software experiments support this affirmation.