Test sets generation from algebraic specifications using logic programming
Journal of Systems and Software
IEEE Transactions on Software Engineering
Comparing the Effectiveness of Software Testing Strategies
IEEE Transactions on Software Engineering
The coupling effect: fact or fiction
TAV3 Proceedings of the ACM SIGSOFT '89 third symposium on Software testing, analysis, and verification
Investigations of the software testing coupling effect
ACM Transactions on Software Engineering and Methodology (TOSEM)
The ASTOOT approach to testing object-oriented programs
ACM Transactions on Software Engineering and Methodology (TOSEM)
Precise Documentation of Well-Structured Programs
IEEE Transactions on Software Engineering
Functional documents for computer systems
Science of Computer Programming
A Framework for Specification-Based Testing
IEEE Transactions on Software Engineering
Object-oriented software construction (2nd ed.)
Object-oriented software construction (2nd ed.)
Using Test Oracles Generated from Program Documentation
IEEE Transactions on Software Engineering
In black and white: an integrated approach to class-level testing of object-oriented programs
ACM Transactions on Software Engineering and Methodology (TOSEM)
Automatically Checking an Implementation against Its Formal Specification
IEEE Transactions on Software Engineering
Data Abstraction, Implementation, Specification, and Testing
ACM Transactions on Programming Languages and Systems (TOPLAS)
A generalized control structure and its formal definition
Communications of the ACM
Communications of the ACM
A technique for software module specification with examples
Communications of the ACM
Mathematics: A Discrete Introduction
Mathematics: A Discrete Introduction
A Simple and Practical Approach to Unit Testing: The JML and JUnit Way
ECOOP '02 Proceedings of the 16th European Conference on Object-Oriented Programming
Testing Applications on the Web: Test Planning for Mobile and Internet-Based Systems
Testing Applications on the Web: Test Planning for Mobile and Internet-Based Systems
Evaluation of Three Specification-Based Testing Criteria
ICECCS '00 Proceedings of the 6th IEEE International Conference on Complex Computer Systems
General Test Result Checking with Log File Analysis
IEEE Transactions on Software Engineering
Experiences evaluating the effectiveness of JML-JUnit testing
ACM SIGSOFT Software Engineering Notes
Generating Test Cases from UML Activity Diagram based on Gray-Box Method
APSEC '04 Proceedings of the 11th Asia-Pacific Software Engineering Conference
Using information about functions in selecting test cases
A-MOST '05 Proceedings of the 1st international workshop on Advances in model-based testing
An empirical framework for comparing effectiveness of testing and property-based formal analysis
PASTE '05 Proceedings of the 6th ACM SIGPLAN-SIGSOFT workshop on Program analysis for software tools and engineering
From MC/DC to RC/DC: formalization and analysis of control-flow testing criteria
Formal Aspects of Computing
Tool-assisted unit-test generation and selection based on operational abstractions
Automated Software Engineering
An empirical analysis and comparison of random testing techniques
Proceedings of the 2006 ACM/IEEE international symposium on Empirical software engineering
An empirical comparison between direct and indirect test result checking approaches
Proceedings of the 3rd international workshop on Software quality assurance
Specification of Software Component Requirements Using the Trace Function Method
ICSEA '06 Proceedings of the International Conference on Software Engineering Advances
Software Testing Research: Achievements, Challenges, Dreams
FOSE '07 2007 Future of Software Engineering
Automatic Software Test Drivers
Computer
State-based Testing is Functional Testing
TAICPART-MUTATION '07 Proceedings of the Testing: Academic and Industrial Conference Practice and Research Techniques - MUTATION
Testing Programs with the Aid of a Compiler
IEEE Transactions on Software Engineering
A relation-based method combining functional and structural testing for test case generation
Journal of Systems and Software
Sufficient mutation operators for measuring test effectiveness
Proceedings of the 30th international conference on Software engineering
Trace-based Reflexive Testing of OO Programs with T2
ICST '08 Proceedings of the 2008 International Conference on Software Testing, Verification, and Validation
Fault Propagation in Tabular Expression-Based Specifications
COMPSAC '08 Proceedings of the 2008 32nd Annual IEEE International Computer Software and Applications Conference
Hi-index | 0.00 |
Context: Testing a module that has memory using the black-box approach has been found to be expensive and relatively ineffective. Instead, testing without knowledge of the specifications (white-box approach) may not be effective in showing whether a program has been properly implemented as stated in its specifications. We propose instead a grey-box approach called Module Documentation-based Testing or MD-Test, the heart of which is an automatic generation of the test oracle from the external and internal views of the module. Objective: This paper presents an empirical analysis and comparison of MD-Test against three existing testing tools. Method: The experiment was conducted using a mutation-testing approach, in two phases that assess the capability of MD-Test in general and its capability of evaluating test results in particular. Results: The results of the general assessment indicate that MD-Test is more effective than the other three tools under comparison, where it is able to detect all faults. The second phase of the experiment, which is significant to this study, compares the capabilities of MD-Test and JUnit-black using the test evaluation results. Likewise, an analysis of the test evaluation results shows that MD-Test is more effective and efficient, where MD-Test is able to detect at least the same number of faults as, or is at par with, the black-box approach. Conclusion: It is concluded that test evaluation using grey-box approach is more effective and efficient that the black-box approach when testing a module that has memory.