Software reliability and dependability: a roadmap
Proceedings of the Conference on The Future of Software Engineering
The Exception Handling Effectiveness of POSIX Operating Systems
IEEE Transactions on Software Engineering
The Design and Verification of the Rio File Cache
IEEE Transactions on Computers
Dependability of COTS Microkernel-Based Systems
IEEE Transactions on Computers - Special issue on fault-tolerant embedded systems
MAFALDA: Microkernel Assessment by Fault Injection and Design Aid
EDCC-3 Proceedings of the Third European Dependable Computing Conference on Dependable Computing
IPDPS '01 Proceedings of the 15th International Parallel & Distributed Processing Symposium
Failure Mode Analysis of CORBA Service Implementations
Middleware '01 Proceedings of the IFIP/ACM International Conference on Distributed Systems Platforms Heidelberg
Performance Evaluation of Exception Handling in I/O Libraries
DSN '01 Proceedings of the 2001 International Conference on Dependable Systems and Networks (formerly: FTCS)
Robustness Testing and Hardening of CORBA ORB Implementations
DSN '01 Proceedings of the 2001 International Conference on Dependable Systems and Networks (formerly: FTCS)
From Experimental Assessment of Fault-Tolerant Systems to Dependability Benchmarking
IPDPS '02 Proceedings of the 16th International Parallel and Distributed Processing Symposium
Robustness Testing of A Distributed Simulation Backplane
ISSRE '99 Proceedings of the 10th International Symposium on Software Reliability Engineering
An Approach to Testing COTS Software for Robustness to Operating System Exceptions and Errors
ISSRE '99 Proceedings of the 10th International Symposium on Software Reliability Engineering
Comparison of Physical and Software-Implemented Fault Injection Techniques
IEEE Transactions on Computers
Random testing of interrupt-driven software
Proceedings of the 5th ACM international conference on Embedded software
Soft-error classification and impact analysis on real-time operating systems
Proceedings of the conference on Design, automation and test in Europe: Proceedings
Comparison-based file server verification
ATEC '05 Proceedings of the annual conference on USENIX Annual Technical Conference
A dependability benchmark for OLTP application environments
VLDB '03 Proceedings of the 29th international conference on Very large data bases - Volume 29
On engineering standards based carrier grade platforms
Proceedings of the 2007 workshop on Engineering fault tolerant systems
Information Assurance: Dependability and Security in Networked Systems
Information Assurance: Dependability and Security in Networked Systems
EIO: error handling is occasionally correct
FAST'08 Proceedings of the 6th USENIX Conference on File and Storage Technologies
Robustness testing oracle using a sequence alignment algorithm
Proceedings of the First International Workshop on Software Test Output Validation
How to advance TPC benchmarks with dependability aspects
TPCTC'10 Proceedings of the Second TPC technology conference on Performance evaluation, measurement and characterization of complex systems
Architecting dependable systems using reflective computing: lessons learnt and some challenges
Architecting dependable systems VII
PREFAIL: a programmable tool for multiple-failure injection
Proceedings of the 2011 ACM international conference on Object oriented programming systems languages and applications
A systematic review of software robustness
Information and Software Technology
Error propagation monitoring on windows mobile-based devices
LADC'07 Proceedings of the Third Latin-American conference on Dependable Computing
Software testing with an operational profile: OP definition
ACM Computing Surveys (CSUR)
Hi-index | 0.01 |
Critical system designers are turning to off-the-shelf operating system (OS) software to reduce costs and time-to-market. Unfortunately, general-purpose OSes do not always respond to exceptional conditions robustly, either accepting exceptional values without complaint, or suffering abnormal task termination. Even though direct measurement is impractical, this paper uses a multi-version comparison technique to reveal a 6% to 19% normalized rate at which exceptional parameter values cause no error report in commercial POSIX OS implementations. Additionally, 168 functions across 13 OSes are compared to reveal common mode robustness failures. While the best single OS has a 12.6% robustness failure rate for system calls, 3.8% of failures are common across all 13 OSes examined. However, combining C library calls with system calls increases these rates to 29.5% for the best single OS and 17.0% for common mode failures. These results suggest that OS implementations are not completely diverse, and that C library functions are both less diverse and less robust than system calls.