DyGen: automatic generation of high-coverage tests via mining gigabytes of dynamic traces

Authors:
Suresh Thummalapenta;Jonathan de Halleux;Nikolai Tillmann;Scott Wadsworth
Affiliations:
Department of Computer Science, North Carolina State University, Raleigh, NC;Microsoft Research, Redmond, WA;Microsoft Research, Redmond, WA;Microsoft Research, Redmond, WA
Venue:
TAP'10 Proceedings of the 4th international conference on Tests and proofs
Year:
2010

Citing 23
Cited 3

Constraint-Based Automatic Test Data Generation

IEEE Transactions on Software Engineering
Predicting the cost-effectiveness of regression testing strategies

SIGSOFT '96 Proceedings of the 4th ACM SIGSOFT symposium on Foundations of software engineering
Symbolic execution and program testing

Communications of the ACM
Bugs as deviant behavior: a general approach to inferring errors in systems code

SOSP '01 Proceedings of the eighteenth ACM symposium on Operating systems principles
Evolutionary testing of classes

ISSTA '04 Proceedings of the 2004 ACM SIGSOFT international symposium on Software testing and analysis
Rostra: A Framework for Detecting Redundant Object-Oriented Unit Tests

Proceedings of the 19th IEEE international conference on Automated software engineering
JCrasher: an automatic robustness tester for Java

Software—Practice & Experience
DART: directed automated random testing

Proceedings of the 2005 ACM SIGPLAN conference on Programming language design and implementation
Parameterized unit tests

Proceedings of the 10th European software engineering conference held jointly with 13th ACM SIGSOFT international symposium on Foundations of software engineering
CUTE: a concolic unit testing engine for C

Proceedings of the 10th European software engineering conference held jointly with 13th ACM SIGSOFT international symposium on Foundations of software engineering
Selective capture and replay of program executions

WODA '05 Proceedings of the third international workshop on Dynamic analysis
Automatic test factoring for java

Proceedings of the 20th IEEE/ACM international Conference on Automated software engineering
Carving differential unit test cases from system test cases

Proceedings of the 14th ACM SIGSOFT international symposium on Foundations of software engineering
Feedback-Directed Random Test Generation

ICSE '07 Proceedings of the 29th international conference on Software Engineering
Detecting object usage anomalies

Proceedings of the the 6th joint meeting of the European software engineering conference and the ACM SIGSOFT symposium on The foundations of software engineering
Differential testing: a new approach to change detection

Proceedings of the the 6th joint meeting of the European software engineering conference and the ACM SIGSOFT symposium on The foundations of software engineering
A System to Generate Test Data and Symbolically Execute Programs

IEEE Transactions on Software Engineering
MSeqGen: object-oriented unit-test generation via mining source code

Proceedings of the the 7th joint meeting of the European software engineering conference and the ACM SIGSOFT symposium on The foundations of software engineering
Improving Structural Testing of Object-Oriented Programs via Integrating Evolutionary Testing and Symbolic Execution

ASE '08 Proceedings of the 2008 23rd IEEE/ACM International Conference on Automated Software Engineering
DiffGen: Automated Regression Unit-Test Generation

ASE '08 Proceedings of the 2008 23rd IEEE/ACM International Conference on Automated Software Engineering
Pex: white box test generation for .NET

TAP'08 Proceedings of the 2nd international conference on Tests and proofs
Eclat: automatic generation and classification of test inputs

ECOOP'05 Proceedings of the 19th European conference on Object-Oriented Programming
Augmenting automatically generated unit-test suites with regression oracle checking

ECOOP'06 Proceedings of the 20th European conference on Object-Oriented Programming

Synthesizing method sequences for high-coverage testing

Proceedings of the 2011 ACM international conference on Object oriented programming systems languages and applications
Sound empirical evidence in software testing

Proceedings of the 34th International Conference on Software Engineering
Leveraging test generation and specification mining for automated bug detection without false positives

Proceedings of the 34th International Conference on Software Engineering

Quantified Score

Hi-index	0.01

Visualization

Abstract

Unit tests of object-oriented code exercise particular sequences of method calls. A key problem when automatically generating unit tests that achieve high structural code coverage is the selection of relevant method-call sequences, since the number of potentially relevant sequences explodes with the number of methods. To address this issue, we propose a novel approach, called DyGen, that generates tests via mining dynamic traces recorded during program executions. Typical program executions tend to exercise only happy paths that do not include error-handling code, and thus recorded traces often do not achieve high structural coverage. To increase coverage, DyGen transforms traces into parameterized unit tests (PUTs) and uses dynamic symbolic execution to generate new unit tests for the PUTs that can achieve high structural code coverage. In this paper, we show an application of DyGen by automatically generating regression tests on a given version of software.