Towards a framework and a benchmark for testing tools for multi-threaded programs: Research Articles

Authors:
Yaniv Eytani;Klaus Havelund;Scott D. Stoller;Shmuel Ur
Affiliations:
Computer Science Department, University of Haifa, Haifa, Israel;Kestrel Technology, NASA Ames Research Center, Moffett Field, CA 94035-1000, U.S.A.;Computer Science Department, State University of New York at Stony Brook, Stony Brook, NY 11794, U.S.A.;IBM Haifa Research Laboratory, Haifa University Campus, Haifa, Israel
Venue:
Concurrency and Computation: Practice & Experience - Parallel and Distributed Systems: Testing and Debugging (PADTAD)
Year:
2007

Citing 0
Cited 25

A state-of-practice questionnaire on verification and validation for concurrent programs

Proceedings of the 2006 workshop on Parallel and distributed systems: testing and debugging
Producing scheduling that causes concurrent programs to fail

Proceedings of the 2006 workshop on Parallel and distributed systems: testing and debugging
Maximising the information gained from an experimental analysis of code inspection and static analysis for concurrent java components

Proceedings of the 2006 ACM/IEEE international symposium on Empirical software engineering
Controlling factors in evaluating path-sensitive error detection techniques

Proceedings of the 14th ACM SIGSOFT international symposium on Foundations of software engineering
ConTest listeners: a concurrency-oriented infrastructure for Java test and heal tools

Fourth international workshop on Software quality assurance: in conjunction with the 6th ESEC/FSE joint meeting
Dynamic detection of atomic-set-serializability violations

Proceedings of the 30th international conference on Software engineering
Racer: effective race detection using aspectj

ISSTA '08 Proceedings of the 2008 international symposium on Software testing and analysis
Towards a better collaboration of static and dynamic analyses for testing concurrent programs

PADTAD '08 Proceedings of the 6th workshop on Parallel and distributed systems: testing, analysis, and debugging
Verify Your Runs

Verified Software: Theories, Tools, Experiments
Language Strength Reduction

SAS '08 Proceedings of the 15th international symposium on Static Analysis
Complementarity of Error Detection Techniques

Electronic Notes in Theoretical Computer Science (ENTCS)
Finding Concurrency-Related Bugs Using Random Isolation

VMCAI '09 Proceedings of the 10th International Conference on Verification, Model Checking, and Abstract Interpretation
A Decision Procedure for Detecting Atomicity Violations for Communicating Processes with Locks

Proceedings of the 16th International SPIN Workshop on Model Checking Software
Efficient Testing of Concurrent Programs with Abstraction-Guided Symbolic Execution

Proceedings of the 16th International SPIN Workshop on Model Checking Software
Saturation-based testing of concurrent programs

Proceedings of the the 7th joint meeting of the European software engineering conference and the ACM SIGSOFT symposium on The foundations of software engineering
Clash of the Titans: tools and techniques for hunting bugs in concurrent programs

Proceedings of the 7th Workshop on Parallel and Distributed Systems: Testing, Analysis, and Debugging
Automatic Debugging of Concurrent Programs through Active Sampling of Low Dimensional Random Projections

ASE '08 Proceedings of the 2008 23rd IEEE/ACM International Conference on Automated Software Engineering
Concurrent Java Test Generation as a Search Problem

Electronic Notes in Theoretical Computer Science (ENTCS)
Explaining intermittent concurrent bugs by minimizing scheduling noise

HVC'06 Proceedings of the 2nd international Haifa verification conference on Hardware and software, verification and testing
Generating counter-examples through randomized guided search

Proceedings of the 14th international SPIN conference on Model checking software
Model classifications and automated verification

FMICS'07 Proceedings of the 12th international conference on Formal methods for industrial critical systems
Falcon: fault localization in concurrent programs

Proceedings of the 32nd ACM/IEEE International Conference on Software Engineering - Volume 1
Finding complex concurrency bugs in large multi-threaded applications

Proceedings of the sixth conference on Computer systems
Variable and thread bounding for systematic testing of multithreaded programs

Proceedings of the 2013 International Symposium on Software Testing and Analysis
Selective mutation testing for concurrent code

Proceedings of the 2013 International Symposium on Software Testing and Analysis

Quantified Score

Hi-index	0.00

Visualization

Abstract

Multi-threaded code is becoming very common, both on the server side, and very recently for personal computers as well. Consequently, looking for intermittent bugs is a problem that is receiving more and more attention. As there is no silver bullet, research focuses on a variety of partial solutions. We outline a road map for combining the research within the different disciplines of testing multi-threaded programs and for evaluating the quality of this research. We have three main goals. First, to create a benchmark that can be used to evaluate different solutions. Second, to create a framework with open application programming interfaces that enables the combination of techniques in the multi-threading domain. Third, to create a focus for the research in this area around which a community of people who try to solve similar problems with different techniques can congregate. We have started creating such a benchmark and describe the lessons learned in the process. The framework will enable technology developers, for example, developers of race detection algorithms, to concentrate on their components and use other ready made components (e.g. an instrumentor) to create a testing solution. Copyright © 2006 John Wiley & Sons, Ltd.