Completeness, robustness, and safety in real-time software requirements specification
ICSE '89 Proceedings of the 11th international conference on Software engineering
An empirical study of the reliability of UNIX utilities
Communications of the ACM
Software Requirements Analysis for Real-Time Process-Control Systems
IEEE Transactions on Software Engineering
Measuring Software Dependability by Robustness Benchmarking
IEEE Transactions on Software Engineering
Representing structural requirements in software architecture
Proceedings of the IFIP TC2 WG2.4 working conference on Systems implementation 2000 : languages, methods and tools: languages, methods and tools
Analyzing exception flow in Java programs
ESEC/FSE-7 Proceedings of the 7th European software engineering conference held jointly with the 7th ACM SIGSOFT international symposium on Foundations of software engineering
Construction of robust class hierarchies
Software—Practice & Experience
On the analysis needs when verifying state-based software requirements: an experience report
Science of Computer Programming
The Exception Handling Effectiveness of POSIX Operating Systems
IEEE Transactions on Software Engineering
Dependability: Basic Concepts and Terminology
Dependability: Basic Concepts and Terminology
The cyclefree methodology: a simple approach to building reliable, robust, real-time systems
Proceedings of the 24th International Conference on Software Engineering
Agent Teams: Building and Implementing Software
IEEE Internet Computing
IEEE Internet Computing
Predicting How Badly "Good" Software Can Behave
IEEE Software
Torture Tests: A Quantitative Analysis for the Robustness of Knowledge-Based Systems
EKAW '00 Proceedings of the 12th European Workshop on Knowledge Acquisition, Modeling and Management
ISMIS '00 Proceedings of the 12th International Symposium on Foundations of Intelligent Systems
Building Robust Applications by Reusing Non-robust Legacy Software
Ada Europe '01 Proceedings of the 6th Ade-Europe International Conference Leuven on Reliable Software Technologies
Non-controllable Choice Robustness Expressing the Controllability of Workflow Processes
ICATPN '02 Proceedings of the 23rd International Conference on Applications and Theory of Petri Nets
System Security Assessment through Specification Mutations and Fault Injection
Proceedings of the IFIP TC6/TC11 International Conference on Communications and Multimedia Security Issues of the New Century
Joint Evaluation of Performance and Robustness of a COTS DBMS through Fault-Injection
DSN '00 Proceedings of the 2000 International Conference on Dependable Systems and Networks (formerly FTCS-30 and DCCA-8)
Robustness Testing of the Microsoft Win32 API
DSN '00 Proceedings of the 2000 International Conference on Dependable Systems and Networks (formerly FTCS-30 and DCCA-8)
Performance Evaluation of Exception Handling in I/O Libraries
DSN '01 Proceedings of the 2001 International Conference on Dependable Systems and Networks (formerly: FTCS)
Robustness Testing and Hardening of CORBA ORB Implementations
DSN '01 Proceedings of the 2001 International Conference on Dependable Systems and Networks (formerly: FTCS)
An Automated Approach to Increasing the Robustness of C Libraries
DSN '02 Proceedings of the 2002 International Conference on Dependable Systems and Networks
Robust Software - No More Excuses
DSN '02 Proceedings of the 2002 International Conference on Dependable Systems and Networks
IPDPS '01 Proceedings of the 15th International Parallel & Distributed Processing Symposium
Robustness analysis of avionics embedded systems
Proceedings of the 2003 ACM SIGPLAN conference on Language, compiler, and tool for embedded systems
Knowledge-based re-engineering of legacy programs for robustness in automated design
KBSE '96 Proceedings of The 11th Knowledge-Based Software Engineering Conference
CSDA '98 Proceedings of the Conference on Computer Security, Dependability, and Assurance: From Needs to Solutions
Improving Software Robustness with Dependability Cases
FTCS '98 Proceedings of the The Twenty-Eighth Annual International Symposium on Fault-Tolerant Computing
Automated Robustness Testing of Off-the-Shelf Software Components
FTCS '98 Proceedings of the The Twenty-Eighth Annual International Symposium on Fault-Tolerant Computing
Comparing the Robustness of POSIX Operating Systems
FTCS '99 Proceedings of the Twenty-Ninth Annual International Symposium on Fault-Tolerant Computing
Wrapping Windows NT Software for Robustness
FTCS '99 Proceedings of the Twenty-Ninth Annual International Symposium on Fault-Tolerant Computing
An Approach to Specify and Test Component-Based Dependable Software
HASE '02 Proceedings of the 7th IEEE International Symposium on High Assurance Systems Engineering
Quantitative evaluation of software quality
ICSE '76 Proceedings of the 2nd international conference on Software engineering
Architecture-based Exception Handling
HICSS '01 Proceedings of the 34th Annual Hawaii International Conference on System Sciences ( HICSS-34)-Volume 9 - Volume 9
Robustness and Diagnosability of OO Systems Designed by Contracts
METRICS '01 Proceedings of the 7th International Symposium on Software Metrics
Fault-oriented Software Robustness Assessment for Multicast Protocols
NCA '03 Proceedings of the Second IEEE International Symposium on Network Computing and Applications
Experimental Assessment of COTS DBMS Robustness under Transient Faults
PRDC '99 Proceedings of the 1999 Pacific Rim International Symposium on Dependable Computing
Comparing Operating Systems Using Robustness Benchmarks
SRDS '97 Proceedings of the 16th Symposium on Reliable Distributed Systems
Testing the Robustness of Windows NT Software
ISSRE '98 Proceedings of the The Ninth International Symposium on Software Reliability Engineering
Robustness Testing of A Distributed Simulation Backplane
ISSRE '99 Proceedings of the 10th International Symposium on Software Reliability Engineering
An Approach to Testing COTS Software for Robustness to Operating System Exceptions and Errors
ISSRE '99 Proceedings of the 10th International Symposium on Software Reliability Engineering
Dependability at the User Interface
FTCS '95 Proceedings of the Twenty-Fifth International Symposium on Fault-Tolerant Computing
Measuring Robustness of a Fault-Tolerant Aerospace System
FTCS '95 Proceedings of the Twenty-Fifth International Symposium on Fault-Tolerant Computing
Requirements by Contracts allow Automated System Testing
ISSRE '03 Proceedings of the 14th International Symposium on Software Reliability Engineering
ASPIRE: Automated Systematic Protocol Implementation Robustness Evaluation
ASWEC '04 Proceedings of the 2004 Australian Software Engineering Conference
Evidence-Based Software Engineering
Proceedings of the 26th International Conference on Software Engineering
Testing of java web services for robustness
ISSTA '04 Proceedings of the 2004 ACM SIGSOFT international symposium on Software testing and analysis
Characterization of the Impact of Faulty Drivers on the Robustness of the Linux Kernel
DSN '04 Proceedings of the 2004 International Conference on Dependable Systems and Networks
JCrasher: an automatic robustness tester for Java
Software—Practice & Experience
Robustness Testing of Java Server Applications
IEEE Transactions on Software Engineering
Assessing the Robustness of Self-Managing Computer Systems under Highly Variable Workloads
ICAC '04 Proceedings of the First International Conference on Autonomic Computing
ICECCS '05 Proceedings of the 10th IEEE International Conference on Engineering of Complex Computer Systems
Self-healing components in robust software architecture for concurrent and distributed systems
Science of Computer Programming - Special issue on system and software architectures(IWSSA'04)
Multiagent Reputation Management to Achieve Robust Software Using Redundancy
IAT '05 Proceedings of the IEEE/WIC/ACM International Conference on Intelligent Agent Technology
Benchmarking the Dependability of Windows and Linux Using PostMark™ Workloads
ISSRE '05 Proceedings of the 16th IEEE International Symposium on Software Reliability Engineering
Automatic recovery from software failure
Communications of the ACM - Self managed systems
A First Draft of RATF: A Method Combining Robustness Analysis and Technology Forecasting
ITNG '06 Proceedings of the Third International Conference on Information Technology: New Generations
On-chip Debugging-based Fault Emulation for Robustness Evaluation of Embedded Software Components
PRDC '05 Proceedings of the 11th Pacific Rim International Symposium on Dependable Computing
Proceedings of the 21st annual ACM SIGPLAN conference on Object-oriented programming systems, languages, and applications
Effective Generation of Interface Robustness Properties for Static Analysis
ASE '06 Proceedings of the 21st IEEE/ACM International Conference on Automated Software Engineering
Injection of faults at component interfaces and inside the component code: are they equivalent?
EDCC '06 Proceedings of the Sixth European Dependable Computing Conference
Mining Interface Specifications for Generating Checkable Robustness Properties
ISSRE '06 Proceedings of the 17th International Symposium on Software Reliability Engineering
A framework and a tool for robustness testing of communicating software
Proceedings of the 2007 ACM symposium on Applied computing
A Systematic Review of Software Development Cost Estimation Studies
IEEE Transactions on Software Engineering
WebSob: A Tool for Robustness Testing of Web Services
ICSE COMPANION '07 Companion to the proceedings of the 29th International Conference on Software Engineering
A pragmatic approach for testing robustness on real-time component based systems
AICCSA '05 Proceedings of the ACS/IEEE 2005 International Conference on Computer Systems and Applications
Robustness and Security Hardening of COTS Software Libraries
DSN '07 Proceedings of the 37th Annual IEEE/IFIP International Conference on Dependable Systems and Networks
Assessing Robustness of Web-Services Infrastructures
DSN '07 Proceedings of the 37th Annual IEEE/IFIP International Conference on Dependable Systems and Networks
A Statistical Approach to Model-Based Robustness Testing
ECBS '07 Proceedings of the 14th Annual IEEE International Conference and Workshops on the Engineering of Computer-Based Systems
Verification and Validation of (Real Time) COTS Products using Fault Injection Techniques
ICCBSS '07 Proceedings of the Sixth International IEEE Conference on Commercial-off-the-Shelf (COTS)-Based Software Systems
ICCGI '07 Proceedings of the International Multi-Conference on Computing in the Global Information Technology
An empirical study of the robustness of Windows NT applications using random testing
WSS'00 Proceedings of the 4th conference on USENIX Windows Systems Symposium - Volume 4
A Formal Approach to Test the Robustness of Embedded Systems using Behaviour Analysis
SERA '07 Proceedings of the 5th ACIS International Conference on Software Engineering Research, Management & Applications
On the Impact of Injection Triggers for OS Robustness Evaluation
ISSRE '07 Proceedings of the The 18th IEEE International Symposium on Software Reliability
Benchmarking the Robustness of Web Services
PRDC '07 Proceedings of the 13th Pacific Rim International Symposium on Dependable Computing
Empirical studies of agile software development: A systematic review
Information and Software Technology
Fault-Based Web Services Testing
ITNG '08 Proceedings of the Fifth International Conference on Information Technology: New Generations
Comparing Robustness of AIS-Based Middleware Implementations
ISAS '07 Proceedings of the 4th international symposium on Service Availability
Bristlecone: A Language for Robust Software Systems
ECOOP '08 Proceedings of the 22nd European conference on Object-Oriented Programming
wsrbench: An On-Line Tool for Robustness Benchmarking
SCC '08 Proceedings of the 2008 IEEE International Conference on Services Computing - Volume 2
Systematic literature reviews in software engineering - A systematic literature review
Information and Software Technology
Verification of Exception Control Flows and Handlers Based on Architectural Scenarios
HASE '08 Proceedings of the 2008 11th IEEE High Assurance Systems Engineering Symposium
A Formal Approach to Robustness Testing of Network Protocol
NPC '08 Proceedings of the IFIP International Conference on Network and Parallel Computing
A systematic review of search-based testing for non-functional system properties
Information and Software Technology
The System-Level Simplex Architecture for Improved Real-Time Embedded System Safety
RTAS '09 Proceedings of the 2009 15th IEEE Symposium on Real-Time and Embedded Technology and Applications
On Non-Functional Requirements in Software Engineering
Conceptual Modeling: Foundations and Applications
TTCN-3 Based Robustness Test Generation and Automation
ITCS '09 Proceedings of the 2009 International Conference on Information Technology and Computer Science - Volume 02
Extending Test-Driven Development for Robust Web Services
DEPEND '09 Proceedings of the 2009 Second International Conference on Dependability
A Model Based Framework for Specifying and Executing Fault Injection Experiments
DEPCOS-RELCOMEX '09 Proceedings of the 2009 Fourth International Conference on Dependability of Computer Systems
Architectural-Based Validation of Fault-Tolerant Software
LADC '09 Proceedings of the 2009 Fourth Latin-American Symposium on Dependable Computing
A systematic review of domain analysis tools
Information and Software Technology
A systematic review on regression test selection techniques
Information and Software Technology
State Based Robustness Testing for Components
Electronic Notes in Theoretical Computer Science (ENTCS)
Robust, Secure, Self-Adaptive and Resilient Messaging Middleware for Business Critical Systems
COMPUTATIONWORLD '09 Proceedings of the 2009 Computation World: Future Computing, Service Computation, Cognitive, Adaptive, Content, Patterns
RTSS '09 Proceedings of the 2009 30th IEEE Real-Time Systems Symposium
A framework for robust active super tier systems
International Journal on Software Tools for Technology Transfer (STTT)
A systematic review on strategic release planning models
Information and Software Technology
Robustness of modular multi-layered software in the automotive domain: a wrapping-based approach
ETFA'09 Proceedings of the 14th IEEE international conference on Emerging technologies & factory automation
A foundational analysis of software robustness using redundant agent collaboration
NODe'02 Proceedings of the NODe 2002 agent-related conference on Agent technologies, infrastructures, tools, and applications for E-services
A Framework for Programming Robust Context-Aware Applications
IEEE Transactions on Software Engineering
Achieving software robustness via large-scale multiagent systems
Software engineering for large-scale multi-agent systems
Evaluating and Comparing the Impact of Software Faults on Web Servers
EDCC '10 Proceedings of the 2010 European Dependable Computing Conference
Robustness testing for software components
Science of Computer Programming
Towards Scalable Robustness Testing
SSIRI '10 Proceedings of the 2010 Fourth International Conference on Secure Software Integration and Reliability Improvement
Robustness Testing of Standard Specifications-Based HA Middleware
ICDCSW '10 Proceedings of the 2010 IEEE 30th International Conference on Distributed Computing Systems Workshops
Applying Text Classification Algorithms in Web Services Robustness Testing
SRDS '10 Proceedings of the 2010 29th IEEE Symposium on Reliable Distributed Systems
A Genetic Algorithm-Based Stress Test Requirements Generator Tool and Its Empirical Evaluation
IEEE Transactions on Software Engineering
Bristlecone: Language Support for Robust Software Applications
IEEE Transactions on Software Engineering
Proceedings of the 33rd International Conference on Software Engineering
A model-based approach for robustness testing
TestCom'05 Proceedings of the 17th IFIP TC6/WG 6.1 international conference on Testing of Communicating Systems
Improving robustness testing of COTS OS extensions
ISAS'06 Proceedings of the Third international conference on Service Availability
Systematic mapping studies in software engineering
EASE'08 Proceedings of the 12th international conference on Evaluation and Assessment in Software Engineering
Performance testing of LiDAR exploitation software
Computers & Geosciences
Hi-index | 0.00 |
Context: With the increased use of software for running key functions in modern society it is of utmost importance to understand software robustness and how to support it. Although there have been many contributions to the field there is a lack of a coherent and summary view. Objective: To address this issue, we have conducted a literature review in the field of robustness. Method: This review has been conducted by following guidelines for systematic literature reviews. Systematic reviews are used to find and classify all existing and available literature in a certain field. Results: From 9193 initial papers found in three well-known research databases, the 144 relevant papers were extracted through a multi-step filtering process with independent validation in each step. These papers were then further analyzed and categorized based on their development phase, domain, research, contribution and evaluation type. The results indicate that most existing results on software robustness focus on verification and validation of Commercial of the shelf (COTS) or operating systems or propose design solutions for robustness while there is a lack of results on how to elicit and specify robustness requirements. The research is typically solution proposals with little to no evaluation and when there is some evaluation it is primarily done with small, toy/academic example systems. Conclusion: We conclude that there is a need for more software robustness research on real-world, industrial systems and on software development phases other than testing and design, in particular on requirements engineering.