An open-source tool for automated generation of black-box xunit test code and its industrial evaluation

Authors:
Christian Wiederseiner;Shahnewaz A. Jolly;Vahid Garousi;Matt M. Eskandar
Affiliations:
Software Quality Engineering Research Group, University of Calgary, Canada;Software Quality Engineering Research Group, University of Calgary, Canada;Software Quality Engineering Research Group, University of Calgary, Canada;MR Control Systems International Inc., Calgary, Canada
Venue:
TAIC PART'10 Proceedings of the 5th international academic and industrial conference on Testing - practice and research techniques
Year:
2010

Citing 8
Cited 0

A Test Generation Strategy for Pairwise Testing

IEEE Transactions on Software Engineering
Experiences evaluating the effectiveness of JML-JUnit testing

ACM SIGSOFT Software Engineering Notes
Model-Based Software Testing and Analysis with C#

Model-Based Software Testing and Analysis with C#
Unit test frameworks

Unit test frameworks
Comparison of Unit-Level Automated Test Generation Tools

ICSTW '09 Proceedings of the IEEE International Conference on Software Testing, Verification, and Validation Workshops
Pex: white box test generation for .NET

TAP'08 Proceedings of the 2nd international conference on Tests and proofs
Foundations of Software Testing

Foundations of Software Testing
Automatic test generation for n-way combinatorial testing

QoSA'05 Proceedings of the First international conference on Quality of Software Architectures and Software Quality, and Proceedings of the Second International conference on Software Quality

Quantified Score

Hi-index	0.00

Visualization

Abstract

The body of knowledge in the area of black-box unit testing is quite well established, e.g., the concepts of category partitioning, boundary value analysis, and pair-wise testing. However, tool support to apply the existing techniques in large-scale industrial software projects is fairly limited. Although tools such as HexaWise enable testers in automatic generation of allcombination pair-wise test input data, nevertheless converting them to actual test case source code (e.g., in NUnit) is both very tedious and also error prone. To address the above challenge, we have developed an open-source tool, referred to as AutoBBUT, for automated generation of black-box NUnit test cases for the C# .Net platform. Evaluation of the tool in an industrial setting by using it to automatically generate more than 1,962 NUnit test cases (having 15,906 test line of code) in NUnit shows the effectiveness of the tool in saving testers a lot of time and also preventing unwanted defects and/or test smells in test code, which can occur due to manual test code development.