Better testing through oracle selection (NIER track)

Authors:
Matt Staats;Michael W. Whalen;Mats P.E. Heimdahl
Affiliations:
University of Minnesota, Twin Cities, MN, USA;University of Minnesota, Twin Cities, MN, USA;University of Minnesota, Twin Cities, MN, USA
Venue:
Proceedings of the 33rd International Conference on Software Engineering
Year:
2011

Citing 11
Cited 3

Specification-based test oracles for reactive systems

ICSE '92 Proceedings of the 14th international conference on Software engineering
Testing: a roadmap

Proceedings of the Conference on The Future of Software Engineering
Synchronous Programming of Reactive Systems

Synchronous Programming of Reactive Systems
Basic Concepts and Taxonomy of Dependable and Secure Computing

IEEE Transactions on Dependable and Secure Computing
Assessing and Improving State-Based Class Testing: A Series of Experiments

IEEE Transactions on Software Engineering
Software Testing and Analysis: Process, Principles and Techniques

Software Testing and Analysis: Process, Principles and Techniques
Coverage metrics for requirements-based testing

Proceedings of the 2006 international symposium on Software testing and analysis
Designing and comparing automated test oracles for GUI-based software applications

ACM Transactions on Software Engineering and Methodology (TOSEM)
Software Testing Research: Achievements, Challenges, Dreams

FOSE '07 2007 Future of Software Engineering
The effect of program and model structure on mc/dc test adequacy coverage

Proceedings of the 30th international conference on Software engineering
Programs, tests, and oracles: the foundations of testing revisited

Proceedings of the 33rd International Conference on Software Engineering

Programs, tests, and oracles: the foundations of testing revisited

Proceedings of the 33rd International Conference on Software Engineering
Automated oracle creation support, or: how I learned to stop worrying about fault propagation and love mutation testing

Proceedings of the 34th International Conference on Software Engineering
Observable modified Condition/Decision coverage

Proceedings of the 2013 International Conference on Software Engineering

Quantified Score

Hi-index	0.00

Visualization

Abstract

In software testing, the test oracle determines if the application under test has performed an execution correctly. In current testing practice and research, significant effort and thought is placed on selecting test inputs, with the selection of test oracles largely neglected. Here, we argue that improvements to the testing process can be made by considering the problem of oracle selection. In particular, we argue that selecting the test oracle and test inputs together to complement one another may yield improvements testing effectiveness. We illustrate this using an example and present selected results from an ongoing study demonstrating the relationship between test suite selection, oracle selection, and fault finding.