Orthogonal Latin squares: an application of experiment design to compiler testing
Communications of the ACM
Partition Testing Does Not Inspire Confidence (Program Testing)
IEEE Transactions on Software Engineering
Protocol validation: principles and applications
Computer Networks and ISDN Systems - Special issue on protocol specification, testing and verification
Effect of test set minimization on fault detection effectiveness
Proceedings of the 17th international conference on Software engineering
Applying design of experiments to software testing: experience report
ICSE '97 Proceedings of the 19th international conference on Software engineering
Combinatorial theory (2nd ed.)
Combinatorial theory (2nd ed.)
Quality Engineering Using Robust Design
Quality Engineering Using Robust Design
Model-based testing in practice
Proceedings of the 21st international conference on Software engineering
A new method for constructing pair-wise covering designs for software testing
Information Processing Letters
Covering Arrays of Strength Three
Designs, Codes and Cryptography
A Test Generation Strategy for Pairwise Testing
IEEE Transactions on Software Engineering
Lower Bounds for Group Covering Designs
AAECC-13 Proceedings of the 13th International Symposium on Applied Algebra, Algebraic Algorithms and Error-Correcting Codes
Applicability of Non-Specification-Based Approaches to Logic Testing for Software
DSN '01 Proceedings of the 2001 International Conference on Dependable Systems and Networks (formerly: FTCS)
Extended Model-Based Testing toward High Code Coverage Rate
ECSQ '02 Proceedings of the 7th International Conference on Software Quality
Constructing test suites for interaction testing
Proceedings of the 25th International Conference on Software Engineering
Efficient software testing protocols
CASCON '98 Proceedings of the 1998 conference of the Centre for Advanced Studies on Collaborative research
An Approach to Automated Program Testing and Debugging
APSEC '99 Proceedings of the Sixth Asia Pacific Software Engineering Conference
An Investigation of the Applicability of Design of Experiments to Software Testing
SEW '02 Proceedings of the 27th Annual NASA Goddard Software Engineering Workshop (SEW-27'02)
AETGSM Web: A Web Based Service for Automatic Efficient Test Generation from Functional Requirements
WIFT '98 Proceedings of the Second IEEE Workshop on Industrial Strength Formal Specification Techniques
Efficient Regression Testing of Multi-Panel Systems
ISSRE '99 Proceedings of the 10th International Symposium on Software Reliability Engineering
SALT - An Integrated Environment to Automate Generation of Function Tests for APIs
ISSRE '00 Proceedings of the 11th International Symposium on Software Reliability Engineering
Efficient Evaluation of Multifactor Dependent System Performance Using Fractional Factorial Design
IEEE Transactions on Software Engineering
Fully automated interoperability test suite derivation for communication protocols
Computer Networks: The International Journal of Computer and Telecommunications Networking
Constructions of difference covering arrays
Journal of Combinatorial Theory Series A
Upper bounds for covering arrays by tabu search
Discrete Applied Mathematics - Optimal discrete structure and algorithms (ODSA 2000)
Software Fault Interactions and Implications for Software Testing
IEEE Transactions on Software Engineering
Covering arrays for efficient fault characterization in complex configuration spaces
ISSTA '04 Proceedings of the 2004 ACM SIGSOFT international symposium on Software testing and analysis
Using Artificial Life Techniques to Generate Test Cases for Combinatorial Testing
COMPSAC '04 Proceedings of the 28th Annual International Computer Software and Applications Conference - Volume 01
On the Testing of Particular Input Conditions
COMPSAC '04 Proceedings of the 28th Annual International Computer Software and Applications Conference - Volume 01
Experimental designs in software engineering: d-optimal designs and covering arrays
Proceedings of the 2004 ACM workshop on Interdisciplinary software engineering research
Reflections on Industry Trends and Experimental Research in Dependability
IEEE Transactions on Dependable and Secure Computing
Testing web applications focusing on their specialties
ACM SIGSOFT Software Engineering Notes
A framework of greedy methods for constructing interaction test suites
Proceedings of the 27th international conference on Software engineering
Proceedings of the 5th international workshop on Software and performance
Test prioritization for pairwise interaction coverage
A-MOST '05 Proceedings of the 1st international workshop on Advances in model-based testing
Modeling requirements for combinatorial software testing
A-MOST '05 Proceedings of the 1st international workshop on Advances in model-based testing
Covering Arrays for Efficient Fault Characterization in Complex Configuration Spaces
IEEE Transactions on Software Engineering
Empirical Software Engineering
Experimental program analysis: a new paradigm for program analysis
Proceedings of the 28th international conference on Software engineering
Constraint Models for the Covering Test Problem
Constraints
Experimental program analysis: a new program analysis paradigm
Proceedings of the 2006 international symposium on Software testing and analysis
Coverage and adequacy in software product line testing
Proceedings of the ISSTA 2006 workshop on Role of software architecture for testing and analysis
Roux-type constructions for covering arrays of strengths three and four
Designs, Codes and Cryptography
Testing across configurations: implications for combinatorial testing
ACM SIGSOFT Software Engineering Notes
Code-coverage guided prioritized test generation
Information and Software Technology
Combinatorial testing: learnings from our experience
ACM SIGSOFT Software Engineering Notes
Automatic Test Data Generation for XML Schema-based Partition Testing
AST '07 Proceedings of the Second International Workshop on Automation of Software Test
Interaction testing of highly-configurable systems in the presence of constraints
Proceedings of the 2007 international symposium on Software testing and analysis
One-test-at-a-time heuristic search for interaction test suites
Proceedings of the 9th annual conference on Genetic and evolutionary computation
The test suite generation problem: Optimal instances and their implications
Discrete Applied Mathematics
Towards incremental adaptive covering arrays
Proceedings of the the 6th joint meeting of the European software engineering conference and the ACM SIGSOFT symposium on The foundations of software engineering
Improving random test sets using the diversity oriented test data generation
Proceedings of the 2nd international workshop on Random testing: co-located with the 22nd IEEE/ACM International Conference on Automated Software Engineering (ASE 2007)
Directed random reduction of combinatorial test suites
Proceedings of the 2nd international workshop on Random testing: co-located with the 22nd IEEE/ACM International Conference on Automated Software Engineering (ASE 2007)
Towards incremental adaptive covering arrays
The 6th Joint Meeting on European software engineering conference and the ACM SIGSOFT symposium on the foundations of software engineering: companion papers
Generating combinatorial test suite for interaction relationship
Fourth international workshop on Software quality assurance: in conjunction with the 6th ESEC/FSE joint meeting
Covering array sampling of input event sequences for automated gui testing
Proceedings of the twenty-second IEEE/ACM international conference on Automated software engineering
Designing a combinatorial java unit testing tool
ACST'07 Proceedings of the third conference on IASTED International Conference: Advances in Computer Science and Technology
Configuration-aware regression testing: an empirical study of sampling and prioritization
ISSTA '08 Proceedings of the 2008 international symposium on Software testing and analysis
A backtracking search tool for constructing combinatorial test suites
Journal of Systems and Software
Modeling Input Space for Testing Scientific Computational Software: A Case Study
ICCS '08 Proceedings of the 8th international conference on Computational Science, Part III
The Effectiveness of T-Way Test Data Generation
SAFECOMP '08 Proceedings of the 27th international conference on Computer Safety, Reliability, and Security
Orthogonal array application for optimal combination of software defect detection techniques choices
WSEAS Transactions on Computers
Strength Two Covering Arrays Construction Using a SAT Representation
MICAI '08 Proceedings of the 7th Mexican International Conference on Artificial Intelligence: Advances in Artificial Intelligence
Covering arrays of strength 3 and 4 from holey difference matrices
Designs, Codes and Cryptography
A systematic review of search-based testing for non-functional system properties
Information and Software Technology
Linear hash families and forbidden configurations
Designs, Codes and Cryptography
Merging covering arrays and compressing multiple sequence alignments
Discrete Applied Mathematics
Incremental covering array failure characterization in large configuration spaces
Proceedings of the eighteenth international symposium on Software testing and analysis
Binary Covering Arrays and Existentially Closed Graphs
IWCC '09 Proceedings of the 2nd International Workshop on Coding and Cryptology
Combining Satisfiability Solving and Heuristics to Constrained Combinatorial Interaction Testing
TAP '09 Proceedings of the 3rd International Conference on Tests and Proofs
ICSR '09 Proceedings of the 11th International Conference on Software Reuse: Formal Foundations of Reuse and Domain Engineering
Pattern matching with don't cares and few errors
Journal of Computer and System Sciences
Assessing IRPS as an efficient pairwise test data generation strategy
International Journal of Advanced Intelligence Paradigms
Generation of pairwise test sets using a simulated bee colony algorithm
IRI'09 Proceedings of the 10th IEEE international conference on Information Reuse & Integration
A New Backtracking Algorithm for Constructing Binary Covering Arrays of Variable Strength
MICAI '09 Proceedings of the 8th Mexican International Conference on Artificial Intelligence
Interaction Coverage Meets Path Coverage by SMT Constraint Solving
TESTCOM '09/FATES '09 Proceedings of the 21st IFIP WG 6.1 International Conference on Testing of Software and Communication Systems and 9th International FATES Workshop
Research Issues in the Automated Testing of Ajax Applications
SOFSEM '10 Proceedings of the 36th Conference on Current Trends in Theory and Practice of Computer Science
Upper bounds for covering arrays by tabu search
Discrete Applied Mathematics
An Introduction to Software Testing
Electronic Notes in Theoretical Computer Science (ENTCS)
Constructions of new orthogonal arrays and covering arrays of strength three
Journal of Combinatorial Theory Series A
Information and Software Technology
Generalized framework for selectors with applications in optimal group testing
ICALP'03 Proceedings of the 30th international conference on Automata, languages and programming
Dynamic characterization of web application interfaces
FASE'07 Proceedings of the 10th international conference on Fundamental approaches to software engineering
A framework for testing DBMS features
The VLDB Journal — The International Journal on Very Large Data Bases
A logic-based approach to combinatorial testing with constraints
TAP'08 Proceedings of the 2nd international conference on Tests and proofs
A new strategy for pairwise test case generation
IITA'09 Proceedings of the 3rd international conference on Intelligent information technology application
Reducing field failures in system configurable software: cost-based prioritization
ISSRE'09 Proceedings of the 20th IEEE international conference on software reliability engineering
Using symbolic evaluation to understand behavior in configurable software systems
Proceedings of the 32nd ACM/IEEE International Conference on Software Engineering - Volume 1
Model-based testing and the UML testing profile
Semantics and algebraic specification
Combinatorial test design in practice
Proceedings of the 32nd ACM/IEEE International Conference on Software Engineering - Volume 2
A survey of combinatorial testing
ACM Computing Surveys (CSUR)
Memetic algorithms for constructing binary covering arrays of strength three
EA'09 Proceedings of the 9th international conference on Artificial evolution
Improving the testing and testability of software product lines
SPLC'10 Proceedings of the 14th international conference on Software product lines: going beyond
TAIC PART'10 Proceedings of the 5th international academic and industrial conference on Testing - practice and research techniques
A Formal Logic Approach to Constrained Combinatorial Testing
Journal of Automated Reasoning
MiTS: a new approach of tabu search for constructing mixed covering arrays
MICAI'10 Proceedings of the 9th Mexican international conference on Artificial intelligence conference on Advances in soft computing: Part II
Generating combinatorial test cases by efficient SAT encodings suitable for CDCL SAT solvers
LPAR'10 Proceedings of the 17th international conference on Logic for programming, artificial intelligence, and reasoning
Covering arrays generation methods survey
ISoLA'10 Proceedings of the 4th international conference on Leveraging applications of formal methods, verification, and validation - Volume Part II
Construction of mixed covering arrays of variable strength using a tabu search approach
COCOA'10 Proceedings of the 4th international conference on Combinatorial optimization and applications - Volume Part I
Information Sciences: an International Journal
Evaluating improvements to a meta-heuristic search for constrained interaction testing
Empirical Software Engineering
Automated testing for intelligent agent systems
AOSE'10 Proceedings of the 10th international conference on Agent-oriented software engineering
PTMD: pairwise testing based on module dependency
ACS'06 Proceedings of the 6th WSEAS international conference on Applied computer science
Techniques to reduce a set of test cases
ICCOM'06 Proceedings of the 10th WSEAS international conference on Communications
Pairwise testing of dynamic composite services
Proceedings of the 6th International Symposium on Software Engineering for Adaptive and Self-Managing Systems
A survey of methods for constructing covering arrays
Programming and Computing Software
Efficiently exploring compiler optimization sequences with pairwise pruning
Proceedings of the 1st International Workshop on Adaptive Self-Tuning Computing Systems for the Exaflop Era
The Minimal Failure-Causing Schema of Combinatorial Testing
ACM Transactions on Software Engineering and Methodology (TOSEM)
Feedback driven adaptive combinatorial testing
Proceedings of the 2011 International Symposium on Software Testing and Analysis
Using binary decision diagrams for combinatorial test design
Proceedings of the 2011 International Symposium on Software Testing and Analysis
Characterizing failure-causing parameter interactions by adaptive testing
Proceedings of the 2011 International Symposium on Software Testing and Analysis
A variable strength interaction test suites generation strategy using Particle Swarm Optimization
Journal of Systems and Software
New bounds for binary covering arrays using simulated annealing
Information Sciences: an International Journal
Model-based testing of industrial transformational systems
ICTSS'11 Proceedings of the 23rd IFIP WG 6.1 international conference on Testing software and systems
Coverage-Based, prioritized testing using neural network clustering
ISCIS'06 Proceedings of the 21st international conference on Computer and Information Sciences
Controllable combinatorial coverage in grammar-based testing
TestCom'06 Proceedings of the 18th IFIP TC6/WG6.1 international conference on Testing of Communicating Systems
A software debugging method based on pairwise testing
ICCS'05 Proceedings of the 5th international conference on Computational Science - Volume Part III
Testing and fault diagnosis for web application compatibility based on combinatorial method
ISPA'05 Proceedings of the 2005 international conference on Parallel and Distributed Processing and Applications
Automatic test generation for n-way combinatorial testing
QoSA'05 Proceedings of the First international conference on Quality of Software Architectures and Software Quality, and Proceedings of the Second International conference on Software Quality
Information and Software Technology
Efficient conditional expectation algorithms for constructing hash families
IWOCA'11 Proceedings of the 22nd international conference on Combinatorial Algorithms
Optimal shortening of covering arrays
MICAI'11 Proceedings of the 10th Mexican international conference on Advances in Artificial Intelligence - Volume Part I
Constraint-Based approaches to the covering test problem
CSCLP'04 Proceedings of the 2004 joint ERCIM/CoLOGNET international conference on Recent Advances in Constraints
Robust performance testing for digital forensic tools
Digital Investigation: The International Journal of Digital Forensics & Incident Response
Proceedings of the 1st International Workshop on Visual Interfaces for Ground Truth Collection in Computer Vision Applications
iTree: efficiently discovering high-coverage configurations using interaction trees
Proceedings of the 34th International Conference on Software Engineering
A taxonomy of model-based testing approaches
Software Testing, Verification & Reliability
An empirical evaluation of several test-a-few strategies for testing particular conditions
Software—Practice & Experience
Faulty interaction identification via constraint solving and optimization
SAT'12 Proceedings of the 15th international conference on Theory and Applications of Satisfiability Testing
Randomized post-optimization of covering arrays
European Journal of Combinatorics
Pairwise testing for software product lines: comparison of two approaches
Software Quality Control
T-wise combinatorial interaction test suites construction based on coverage inheritance
Software Testing, Verification & Reliability
Efficiently generating structurally complex inputs with thousands of objects
ECOOP'07 Proceedings of the 21st European conference on Object-Oriented Programming
Coverage-oriented, prioritized testing: a fuzzy clustering approach and case study
LADC'07 Proceedings of the Third Latin-American conference on Dependable Computing
Constraints dependent t-way test suite generation using harmony search strategy
PKAW'12 Proceedings of the 12th Pacific Rim conference on Knowledge Management and Acquisition for Intelligent Systems
An auto-adapted method to generate pairwise test data set
AICI'12 Proceedings of the 4th international conference on Artificial Intelligence and Computational Intelligence
End-to-end reliability of service oriented applications
Information Systems Frontiers
Automatic selection of test execution plans from a video conferencing system product line
Proceedings of the VARiability for You Workshop: Variability Modeling Made Useful for Everyone
Proceedings of the 2013 9th Joint Meeting on Foundations of Software Engineering
Multi-objective test generation for software product lines
Proceedings of the 17th International Software Product Line Conference
Practical pairwise testing for software product lines
Proceedings of the 17th International Software Product Line Conference
PLEDGE: a product line editor and test generation tool
Proceedings of the 17th International Software Product Line Conference co-located workshops
An orchestrated survey of methodologies for automated software test case generation
Journal of Systems and Software
CAiSE'13 Proceedings of the 25th international conference on Advanced Information Systems Engineering
Constructing test cases for n-wise testing from tree-based test models
Proceedings of the Fourth Symposium on Information and Communication Technology
Mixed optimization combinatorial method for constructing covering arrays
Programming and Computing Software
Empirical Software Engineering
| Hi-index | 0.00 |
This paper describes a new approach to testing that uses combinatorial designs to generate tests that cover the pair-wise, triple, or n-way combinations of a system's test parameters. These are the parameters that determine the system's test scenarios. Examples are system configuration parameters, user inputs and other external events. We implemented this new method in the AETG system. The AETG system uses new combinatorial algorithms to generate test sets that cover all valid n-way parameter combinations. The size of an AETG test set grows logarithmically in the number of test parameters. This allows testers to define test models with dozens of parameters. The AETG system is used in a variety of applications for unit, system, and interoperability testing. It has generated both high-level test plans and detailed test cases. In several applications, it greatly reduced the cost of test plan development.