Analyzing Error-Prone System Structure
IEEE Transactions on Software Engineering
In-Process Evaluation for Software Inspection and Test
IEEE Transactions on Software Engineering - Special issue on software reliability
Reducing and estimating the cost of test coverage criteria
Proceedings of the 18th international conference on Software engineering
ADTEST: A Test Data Generation Suite for Ada Software Systems
IEEE Transactions on Software Engineering
Semantics Guided Regression Test Cost Reduction
IEEE Transactions on Software Engineering
Pythia: a regression test selection tool based on textual differencing
ENCRESS '97 IFIP TC5 WG5.4 3rd internatinal conference on on Reliability, quality and safety of software-intensive systems
An empirical study of regression test selection techniques
Proceedings of the 20th international conference on Software engineering
An encompassing life cycle centric survey of software inspection
Journal of Systems and Software
An empirical study of regression test selection techniques
ACM Transactions on Software Engineering and Methodology (TOSEM)
Early Risk-Management by Identification of Fault-prone Modules
Empirical Software Engineering
Uncertain Classification of Fault-Prone Software Modules
Empirical Software Engineering
IDATG: An Open Tool for Automated Testing of Interactive Software
COMPSAC '98 Proceedings of the 22nd International Computer Software and Applications Conference
Automatic Generation of a Compact Test Suit
Proceedings of the IFIP 12th World Computer Congress on Algorithms, Software, Architecture - Information Processing '92, Volume 1 - Volume I
An Empirical Study on Object-Oriented Metrics
METRICS '99 Proceedings of the 6th International Symposium on Software Metrics
Software Reliability Modeling and Cost Estimation Incorporating Testing-Effort and Efficiency
ISSRE '99 Proceedings of the 10th International Symposium on Software Reliability Engineering
Optimal Allocation of Testing Resources for Modular Software Systems
ISSRE '02 Proceedings of the 13th International Symposium on Software Reliability Engineering
An empirical comparison and characterization of high defect and high complexity modules
Journal of Systems and Software
Generating, Selecting and Prioritizing Test Cases from Specifications with Tool Support
QSIC '03 Proceedings of the Third International Conference on Quality Software
Reviewing 25 Years of Testing Technique Experiments
Empirical Software Engineering
A Modular Tool for Automated Coverage in Software Testing
STEP '03 Proceedings of the Eleventh Annual International Workshop on Software Technology and Engineering Practice
Metrics Suite for Class Complexity
ITCC '05 Proceedings of the International Conference on Information Technology: Coding and Computing (ITCC'05) - Volume II - Volume 02
Effective Generation of Test Sequences for Structural Testing of Concurrent Programs
ICECCS '05 Proceedings of the 10th IEEE International Conference on Engineering of Complex Computer Systems
An exploration of statistical models for automated test case generation
WODA '05 Proceedings of the third international workshop on Dynamic analysis
Early estimation of defect density using an in-process Haskell metrics model
A-MOST '05 Proceedings of the 1st international workshop on Advances in model-based testing
Journal of Systems and Software
A framework and tool supports for generating test inputs of AspectJ programs
Proceedings of the 5th international conference on Aspect-oriented software development
Bi-Objective Model for Test-Suite Reduction Based on Modified Condition/Decision Coverage
PRDC '05 Proceedings of the 11th Pacific Rim International Symposium on Dependable Computing
Improving test suites for efficient fault localization
Proceedings of the 28th international conference on Software engineering
Proceedings of the 28th international conference on Software engineering
What Do We Know about Defect Detection Methods?
IEEE Software
Automation of GUI testing using a model-driven approach
Proceedings of the 2006 international workshop on Automation of software test
Towards regression test selection for AspectJ programs
Proceedings of the 2nd workshop on Testing aspect-oriented programs
Code-coverage guided prioritized test generation
Information and Software Technology
CP-Miner: a tool for finding copy-paste and related bugs in operating system code
OSDI'04 Proceedings of the 6th conference on Symposium on Opearting Systems Design & Implementation - Volume 6
Reducing verification effort in component-based software engineering through built-in testing
Information Systems Frontiers
WoSQ '07 Proceedings of the 5th International Workshop on Software Quality
ICIMP '07 Proceedings of the Second International Conference on Internet Monitoring and Protection
Test Inspected Unit or Inspect Unit Tested Code?
ESEM '07 Proceedings of the First International Symposium on Empirical Software Engineering and Measurement
A Coverage Relationship Model for Test Case Selection and Ranking for Multi-version Software
HASE '07 Proceedings of the 10th IEEE High Assurance Systems Engineering Symposium
Enhancing the Efficiency of Regression Testing through Intelligent Agents
ICCIMA '07 Proceedings of the International Conference on Computational Intelligence and Multimedia Applications (ICCIMA 2007) - Volume 01
Using In-Process Testing Metrics to Estimate Post-Release Field Quality
ISSRE '07 Proceedings of the The 18th IEEE International Symposium on Software Reliability
Journal of Systems and Software
Heuristics-based infeasible path detection for dynamic test data generation
Information and Software Technology
Companion of the 30th international conference on Software engineering
Journal of Software Maintenance and Evolution: Research and Practice
CITWORKSHOPS '08 Proceedings of the 2008 IEEE 8th International Conference on Computer and Information Technology Workshops
An Evaluation of Two Bug Pattern Tools for Java
ICST '08 Proceedings of the 2008 International Conference on Software Testing, Verification, and Validation
Test Instrumentation and Pattern Matching for Automatic Failure Identification
ICST '08 Proceedings of the 2008 International Conference on Software Testing, Verification, and Validation
Dynamic test input generation for web applications
ISSTA '08 Proceedings of the 2008 international symposium on Software testing and analysis
Exploring the relationship of history characteristics and defect count: an empirical study
DEFECTS '08 Proceedings of the 2008 workshop on Defects in large software systems
An empirical model to predict security vulnerabilities using code complexity metrics
Proceedings of the Second ACM-IEEE international symposium on Empirical software engineering and measurement
Automated Acceptance Testing: A Literature Review and an Industrial Case Study
AGILE '08 Proceedings of the Agile 2008
Systematic literature reviews in software engineering - A systematic literature review
Information and Software Technology
Automatic Generation of Testing Environments for Web Applications
CSSE '08 Proceedings of the 2008 International Conference on Computer Science and Software Engineering - Volume 02
A generalized software fault classification model
WSEAS Transactions on Computers
A Novel Approach for Scenario-Based Test Case Generation
ICIT '08 Proceedings of the 2008 International Conference on Information Technology
Review: A systematic review of software fault prediction studies
Expert Systems with Applications: An International Journal
Automated test data generation for aspect-oriented programs
Proceedings of the 8th ACM international conference on Aspect-oriented software development
A generalized software fault classification model
ICCOMP'08 Proceedings of the 12th WSEAS international conference on Computers
An empirical study of incorporating cost into test suite reduction and prioritization
Proceedings of the 2009 ACM symposium on Applied Computing
Reducing the Costs of Bounded-Exhaustive Testing
FASE '09 Proceedings of the 12th International Conference on Fundamental Approaches to Software Engineering: Held as Part of the Joint European Conferences on Theory and Practice of Software, ETAPS 2009
Software for Dependable Systems: Sufficient Evidence?
Software for Dependable Systems: Sufficient Evidence?
ICSTW '09 Proceedings of the IEEE International Conference on Software Testing, Verification, and Validation Workshops
Unified framework for developing testing effort dependent software reliability growth models
WSEAS TRANSACTIONS on SYSTEMS
Test Cases Generation for Embedded Real-Time Software Based on Extended UML
ITCS '09 Proceedings of the 2009 International Conference on Information Technology and Computer Science - Volume 01
Evolution and Search Based Metrics to Improve Defects Prediction
SSBSE '09 Proceedings of the 2009 1st International Symposium on Search Based Software Engineering
Common Trends in Software Fault and Failure Data
IEEE Transactions on Software Engineering
Automating test case definition using a domain specific language
Proceedings of the 46th Annual Southeast Regional Conference on XX
ICIE '09 Proceedings of the 2009 WASE International Conference on Information Engineering - Volume 01
Combinatorial Software Testing
Computer
Computers and Industrial Engineering
Journal of Systems and Software
Unit Testing Approaches for BPEL: A Systematic Review
APSEC '09 Proceedings of the 2009 16th Asia-Pacific Software Engineering Conference
Combinatorial Approach for Automated Platform Diversity Testing
ICSEA '09 Proceedings of the 2009 Fourth International Conference on Software Engineering Advances
A New Strategy for Pairwise Test Case Generation
IITA '09 Proceedings of the 2009 Third International Symposium on Intelligent Information Technology Application - Volume 03
A New Approach to Automated Redundancy Reduction for Test Sequences
PRDC '09 Proceedings of the 2009 15th IEEE Pacific Rim International Symposium on Dependable Computing
SSIRI '09 Proceedings of the 2009 Third IEEE International Conference on Secure Software Integration and Reliability Improvement
Automatic Test Data Generation for C Programs
SSIRI '09 Proceedings of the 2009 Third IEEE International Conference on Secure Software Integration and Reliability Improvement
An Optimization Method of Test Suite in Regression Test Model
WCSE '09 Proceedings of the 2009 WRI World Congress on Software Engineering - Volume 04
OConGraX --- Automatically Generating Data-Flow Test Cases for Fault-Tolerant Systems
TESTCOM '09/FATES '09 Proceedings of the 21st IFIP WG 6.1 International Conference on Testing of Software and Communication Systems and 9th International FATES Workshop
An Automatic Generation Method of Executable Test Case Using Model-Driven Architecture
ICICIC '09 Proceedings of the 2009 Fourth International Conference on Innovative Computing, Information and Control
Boundary Value Testing Using Integrated Circuit Fault Detection Rule
TAIC-PART '09 Proceedings of the 2009 Testing: Academic and Industrial Conference - Practice and Research Techniques
Reggae: Automated Test Generation for Programs Using Complex Regular Expressions
ASE '09 Proceedings of the 2009 IEEE/ACM International Conference on Automated Software Engineering
Information and Software Technology
Redundancy based test-suite reduction
FASE'07 Proceedings of the 10th international conference on Fundamental approaches to software engineering
An intermediate representation approach to reducing test suites for retargeted compilers
Ada-Europe'07 Proceedings of the 12th international conference on Reliable software technologies
Top-Down Reuse for Multi-level Testing
ECBS '10 Proceedings of the 2010 17th IEEE International Conference and Workshops on the Engineering of Computer-Based Systems
Mutation Testing Cost Reduction Techniques: A Survey
IEEE Software
Study of ERP Test-Suite Reduction Based on Modified Condition/Decision Coverage
ICCRD '10 Proceedings of the 2010 Second International Conference on Computer Research and Development
Automated Behavioral Regression Testing
ICST '10 Proceedings of the 2010 Third International Conference on Software Testing, Verification and Validation
Software Quality Prediction Models Compared
QSIC '10 Proceedings of the 2010 10th International Conference on Quality Software
Software Fault Prediction Models for Web Applications
COMPSACW '10 Proceedings of the 2010 IEEE 34th Annual Computer Software and Applications Conference Workshops
Optimal Regression Testing Based on Selective Coverage of Test Requirements
ISPA '10 Proceedings of the International Symposium on Parallel and Distributed Processing with Applications
Search-based Prediction of Fault-slip-through in Large Software Projects
SSBSE '10 Proceedings of the 2nd International Symposium on Search Based Software Engineering
IEEE Transactions on Software Engineering
A method for evaluating rigor and industrial relevance of technology evaluations
Empirical Software Engineering
Optimizing cost and quality by integrating inspection and test processes
Proceedings of the 2011 International Conference on Software and Systems Process
Efficient Reduction of Model-Based Generated Test Suites through Test Case Pair Prioritization
MODEVVA '10 Proceedings of the 2010 Workshop on Model-Driven Engineering, Verification, and Validation
Six years of systematic literature reviews in software engineering: An updated tertiary study
Information and Software Technology
Automatic test data generation by multi-objective optimisation
SAFECOMP'06 Proceedings of the 25th international conference on Computer Safety, Reliability, and Security
Automated generation and evaluation of dataflow-based test data for object-oriented software
QoSA'05 Proceedings of the First international conference on Quality of Software Architectures and Software Quality, and Proceedings of the Second International conference on Software Quality
A method for information systems testing automation
CAiSE'05 Proceedings of the 17th international conference on Advanced Information Systems Engineering
Regression test selection for testable classes
EDCC'05 Proceedings of the 5th European conference on Dependable Computing
A semantic framework for test coverage
ATVA'06 Proceedings of the 4th international conference on Automated Technology for Verification and Analysis
PROFES'10 Proceedings of the 11th international conference on Product-Focused Software Process Improvement
Systematic mapping studies in software engineering
EASE'08 Proceedings of the 12th international conference on Evaluation and Assessment in Software Engineering
An object-oriented framework for improving software reuse on automated testing of mobile phones
TestCom'07/FATES'07 Proceedings of the 19th IFIP TC6/WG6.1 international conference, and 7th international conference on Testing of Software and Communicating Systems
ACM SIGSOFT Software Engineering Notes
More testers - The effect of crowd size and time restriction in software testing
Information and Software Technology
Empirical evidence on OCL formal specification-based metrics as a predictor of fault-proneness
ACM SIGSOFT Software Engineering Notes
Hi-index | 0.00 |
Context: Quality assurance effort, especially testing effort, is often a major cost factor during software development, which sometimes consumes more than 50% of the overall development effort. Consequently, one major goal is often to reduce testing effort. Objective: The main goal of the systematic mapping study is the identification of existing approaches that are able to reduce testing effort. Therefore, an overview should be presented both for researchers and practitioners in order to identify, on the one hand, future research directions and, on the other hand, potential for improvements in practical environments. Method: Two researchers performed a systematic mapping study, focusing on four databases with an initial result set of 4020 articles. Results: In total, we selected and categorized 144 articles. Five different areas were identified that exploit different ways to reduce testing effort: approaches that predict defect-prone parts or defect content, automation, test input reduction approaches, quality assurance techniques applied before testing, and test strategy approaches. Conclusion: The results reflect an increased interest in this topic in recent years. A lot of different approaches have been developed, refined, and evaluated in different environments. The highest attention was found with respect to automation and prediction approaches. In addition, some input reduction approaches were found. However, in terms of combining early quality assurance activities with testing to reduce test effort, only a small number of approaches were found. Due to the continuous challenge of reducing test effort, future research in this area is expected.