Orthogonal Defect Classification-A Concept for In-Process Measurements
IEEE Transactions on Software Engineering - Special issue on software measurement principles, techniques, and environments
Measurement-based analysis of software reliability
Handbook of software reliability engineering
Orthogonal defect classification
Handbook of software reliability engineering
Software metrics (2nd ed.): a rigorous and practical approach
Software metrics (2nd ed.): a rigorous and practical approach
Pilot studies: what, why, and how
Journal of Systems and Software
Building Knowledge through Families of Experiments
IEEE Transactions on Software Engineering
Qualitative Methods in Empirical Studies of Software Engineering
IEEE Transactions on Software Engineering
A Critique of Software Defect Prediction Models
IEEE Transactions on Software Engineering
Software maintenance and evolution: a roadmap
Proceedings of the Conference on The Future of Software Engineering
Validation of an Approach for Improving Existing Measurement Frameworks
IEEE Transactions on Software Engineering
IEEE Transactions on Software Engineering - Special section on the seventh international software metrics symposium
Statistical Software Engineering
Statistical Software Engineering
The distribution of faults in a large industrial software system
ISSTA '02 Proceedings of the 2002 ACM SIGSOFT international symposium on Software testing and analysis
Classification and evaluation of defects in a project retrospective
Journal of Systems and Software
Learning from Our Mistakes with Defect Causal Analysis
IEEE Software
Test and Development Process Retrospective - A Case Study using ODC Triggers
DSN '02 Proceedings of the 2002 International Conference on Dependable Systems and Networks
Requirements discovery during the testing of safety-critical software
Proceedings of the 25th International Conference on Software Engineering
The Repeatability of Code Defect Classifications
ISSRE '98 Proceedings of the The Ninth International Symposium on Software Reliability Engineering
Worst Case Reliability Prediction Based on a Prior Estimate of Residual Defects
ISSRE '02 Proceedings of the 13th International Symposium on Software Reliability Engineering
Operational anomalies as a cause of safety-critical requirements evolution
Journal of Systems and Software
Resolving Requirements Discovery in Testing and Operations
RE '03 Proceedings of the 11th IEEE International Conference on Requirements Engineering
Requirements discovery during the testing of safety-critical software
Proceedings of the 25th International Conference on Software Engineering
A literature survey of the quality economics of defect-detection techniques
Proceedings of the 2006 ACM/IEEE international symposium on Empirical software engineering
Hidden Implementation Dependencies in High Assurance and Critical Computing Systems
IEEE Transactions on Software Engineering
Engineering, communication, and safety
SCS '07 Proceedings of the twelfth Australian workshop on Safety critical systems and software and safety-related programmable systems - Volume 86
A model for software rework reduction through a combination of anomaly metrics
Journal of Systems and Software
Software product line engineering for long-lived, sustainable systems
SPLC'10 Proceedings of the 14th international conference on Software product lines: going beyond
Empirical evaluation of reliability improvement in an evolving software product line
Proceedings of the 8th Working Conference on Mining Software Repositories
Experiences with text mining large collections of unstructured systems development artifacts at jpl
Proceedings of the 33rd International Conference on Software Engineering
Are change metrics good predictors for an evolving software product line?
Proceedings of the 7th International Conference on Predictive Models in Software Engineering
Results and experiences from an empirical study of fault reports in industrial projects
PROFES'06 Proceedings of the 7th international conference on Product-Focused Software Process Improvement
AutoODC: Automated generation of Orthogonal Defect Classifications
ASE '11 Proceedings of the 2011 26th IEEE/ACM International Conference on Automated Software Engineering
EuroSPI'07 Proceedings of the 14th European conference on Software Process Improvement
Journal of Systems and Software
Hi-index | 0.00 |
Analysis of anomalies that occur during operations is an important means of improving the quality of current and future software. Although the benefits of anomaly analysis of operational software are widely recognized, there has been relatively little research on anomaly analysis of safety-critical systems. In particular, patterns of software anomaly data for operational, safety-critical systems are not well understood. This paper presents the results of a pilot study using Orthogonal Defect Classification (ODC) to analyze nearly two hundred such anomalies on seven spacecraft systems. These data show several unexpected classification patterns such as the causal role of difficulties accessing or delivering data, of hardware degradation, and of rare events. The anomalies often revealed latent software requirements that were essential for robust, correct operation of the system. The anomalies also caused changes to documentation and to operational procedures to prevent the same anomalous situations from recurring. Feedback from operational anomaly reports helped measure the accuracy of assumptions about operational profiles, identified unexpected dependencies among embedded software and their systems and environment, and indicated needed improvements to the software, the development process, and the operational procedures. The results indicate that, for long-lived, critical systems, analysis of the most severe anomalies can be a useful mechanism both for maintaining safer, deployed systems and for building safer, similar systems in the future.