An empirical study of static call graph extractors
ACM Transactions on Software Engineering and Methodology (TOSEM)
Evaluating software engineering methods and tools part 12: evaluating DESMET
ACM SIGSOFT Software Engineering Notes
An evaluation of reverse engineering tool capabilities
Journal of Software Maintenance: Research and Practice
A general framework for formalizing UML with formal languages
ICSE '01 Proceedings of the 23rd International Conference on Software Engineering
Benchmark Handbook: For Database and Transaction Processing Systems
Benchmark Handbook: For Database and Transaction Processing Systems
Requirements and Specification Exemplars
Automated Software Engineering
Towards a software evolution benchmark
IWPSE '01 Proceedings of the 4th International Workshop on Principles of Software Evolution
Evaluating Architectural Extractors
WCRE '98 Proceedings of the Working Conference on Reverse Engineering (WCRE'98)
A Structured Demonstration of Five Program Comprehension Tools: Lessons Learnt
WCRE '00 Proceedings of the Seventh Working Conference on Reverse Engineering (WCRE'00)
A Structured Demonstration of Program Comprehension Tools
WCRE '00 Proceedings of the Seventh Working Conference on Reverse Engineering (WCRE'00)
GXL: Toward a Standard Exchange Format
WCRE '00 Proceedings of the Seventh Working Conference on Reverse Engineering (WCRE'00)
Towards a Standard Schema for C/C++
WCRE '01 Proceedings of the Eighth Working Conference on Reverse Engineering (WCRE'01)
On Using a Benchmark to Evaluate C++ Extractors
IWPC '02 Proceedings of the 10th International Workshop on Program Comprehension
Report on the First International Workshop on Comparative Evaluation in Requirements Engineering
ACM SIGSOFT Software Engineering Notes
The Second International Workshop on Detection of Software Clones: workshop report
ACM SIGSOFT Software Engineering Notes
Proceedings of the 2006 international workshop on Global integrated model management
Research ethics and computer science: an unconsummated marriage
SIGDOC '06 Proceedings of the 24th annual ACM international conference on Design of communication
Electronic Notes in Theoretical Computer Science (ENTCS)
New Frontiers of Reverse Engineering
FOSE '07 2007 Future of Software Engineering
A Framework for Empirical Evaluation of Model Comprehensibility
MISE '07 Proceedings of the International Workshop on Modeling in Software Engineering
Empirical studies in reverse engineering: state of the art and future trends
Empirical Software Engineering
Analyzing the performance of a cluster-based architecture for immersive visualization systems
Journal of Parallel and Distributed Computing
Proceedings of the Second ACM-IEEE international symposium on Empirical software engineering and measurement
BegBunch: benchmarking for C bug detection tools
Proceedings of the 2nd International Workshop on Defects in Large Software Systems: Held in conjunction with the ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA 2009)
On the evaluation of recommender systems with recorded interactions
SUITE '09 Proceedings of the 2009 ICSE Workshop on Search-Driven Development-Users, Infrastructure, Tools and Evaluation
Applying a Model Transformation Taxonomy to Graph Transformation Technology
Electronic Notes in Theoretical Computer Science (ENTCS)
Improving code completion with program history
Automated Software Engineering
Toward an ecological sensibility: tools for evaluating sustainable HCI
CHI '10 Extended Abstracts on Human Factors in Computing Systems
On the application of software metrics to UML models
MoDELS'06 Proceedings of the 2006 international conference on Models in software engineering
Towards a unified fault-detection benchmark
Proceedings of the 9th ACM SIGPLAN-SIGSOFT workshop on Program analysis for software tools and engineering
Linking e-mails and source code artifacts
Proceedings of the 32nd ACM/IEEE International Conference on Software Engineering - Volume 1
Automatic construction of an effective training set for prioritizing static analysis warnings
Proceedings of the IEEE/ACM international conference on Automated software engineering
Validity concerns in software engineering research
Proceedings of the FSE/SDP workshop on Future of software engineering research
Information and Software Technology
Custom-made instrumentation based on static analysis
Proceedings of the Ninth International Workshop on Dynamic Analysis
Towards a benchmark for traceability
Proceedings of the 12th International Workshop on Principles of Software Evolution and the 7th annual ERCIM Workshop on Software Evolution
Guidelines for benchmarking the performance of ontology management APIs
ISWC'05 Proceedings of the 4th international conference on The Semantic Web
Benchmark suites for improving the RDF(S) importers and exporters of ontology development tools
ESWC'06 Proceedings of the 3rd European conference on The Semantic Web: research and applications
A method for performing an exhaustive evaluation of RDF(S) importers
WISE'05 Proceedings of the 2005 international conference on Web Information Systems Engineering
Assessing 3-d integrated software development processes: a new benchmark
SPW/ProSim'06 Proceedings of the 2006 international conference on Software Process Simulation and Modeling
A testing strategy for abstract classes
Software Testing, Verification & Reliability
A benchmark for OCL engine accuracy, determinateness, and efficiency
Software and Systems Modeling (SoSyM)
Evaluating defect prediction approaches: a benchmark and an extensive comparison
Empirical Software Engineering
Proceedings of the 2012 Workshop on Parallel and Distributed Systems: Testing, Analysis, and Debugging
MSEPT'12 Proceedings of the 2012 international conference on Multicore Software Engineering, Performance, and Tools
Empirical Software Engineering
| Hi-index | 0.00 |
Benchmarks have been used in computer science to compare the performance of computer systems, information retrieval algorithms, databases, and many other technologies. The creation and widespread use of a benchmark within a research area is frequently accompanied by rapid technical progress and community building. These observations have led us to formulate a theory of benchmarking within scientific disciplines. Based on this theory, we challenge software engineering research to become more scientific and cohesive by working as a community to define benchmarks. In support of this challenge, we present a case study of the reverse engineering community, where we have successfully used benchmarks to advance the state of research.