Software errors and complexity: an empirical investigation0
Communications of the ACM
An experimental evaluation of the assumption of independence in multiversion programming
IEEE Transactions on Software Engineering
Encyclopedia of computer science (3rd ed.)
Encyclopedia of computer science (3rd ed.)
Experimental evaluation in computer science: a quantitative study
Journal of Systems and Software
Turing Award lecture on computational complexity and the nature of computer science
Communications of the ACM
The computer scientist as toolsmith II
Communications of the ACM
How the “what” becomes the “how”
Communications of the ACM
ACM SIGARCH Computer Architecture News
Communications of the ACM
Assessing Software Review Meetings: Results of a Comparative Analysis of Two Experimental Studies
IEEE Transactions on Software Engineering
A Controlled Experiment to Assess the Benefits of Procedure Argument Type Checking
IEEE Transactions on Software Engineering
Eras of Software Technology Transfer
IEEE Software
Reexamining the Fault Density-Component Size Connection
IEEE Software
Empirical exploration in undergraduate operating systems
SIGCSE '99 The proceedings of the thirtieth SIGCSE technical symposium on Computer science education
Introducing empirical investigation in undergraduate operating systems
ACM SIGOPS Operating Systems Review
Empirical investigation throughout the CS curriculum
Proceedings of the thirty-first SIGCSE technical symposium on Computer science education
Experimentation with bounded buffer synchronization
Proceedings of the thirty-first SIGCSE technical symposium on Computer science education
Starving philosophers: experimentation with monitor synchronization
Proceedings of the thirty-second SIGCSE technical symposium on Computer Science Education
The coming-of-age of software architecture research
ICSE '01 Proceedings of the 23rd International Conference on Software Engineering
The invisible future
Disequilibration for teaching the scientific method in computer science
SIGCSE '02 Proceedings of the 33rd SIGCSE technical symposium on Computer science education
Scientific experimentation via the matching game
SIGCSE '02 Proceedings of the 33rd SIGCSE technical symposium on Computer science education
Introduction to Special Issue on Usability Engineering
Empirical Software Engineering
Can you Trust a Single Data Source Exploratory Software Engineering Case Study?
Empirical Software Engineering
A Review of Experimental Investigations into Object-Oriented Technology
Empirical Software Engineering
Preliminary guidelines for empirical research in software engineering
IEEE Transactions on Software Engineering
A Taxonomy to Compare SPI Frameworks
EWSPT '01 Proceedings of the 8th European Workshop on Software Process Technology
Persistence and Java - A Balancing Act
Proceedings of the International Symposium on Objects and Databases
Network Visualization of Heterogeneous US Army War Reserve Readiness Data
MIS '98 Proceedings of the 4th International Workshop on Advances in Multimedia Information Systems
A web-based support environment for software engineering experiments
Nordic Journal of Computing
The use of ill-defined problems for developing problem-solving and empirical skills in CS1
Journal of Computing Sciences in Colleges
Using benchmarking to advance research: a challenge to software engineering
Proceedings of the 25th International Conference on Software Engineering
Panel: empirical validation: what, why, when, and how
Proceedings of the 25th International Conference on Software Engineering
Writing good software engineering research papers: minitutorial
Proceedings of the 25th International Conference on Software Engineering
Formal modeling in a commercial setting: a case study
Journal of Systems and Software
Using finite experiments to study asymptotic performance
Experimental algorithmics
Experimental validation of new software technology
Lecture notes on empirical software engineering
CASE tool evaluation: experiences from an empirical study
Journal of Systems and Software
Formulation and preliminary test of an empirical theory of coordination in software engineering
Proceedings of the 9th European software engineering conference held jointly with 11th ACM SIGSOFT international symposium on Foundations of software engineering
Architecture-level modifiability analysis (ALMA)
Journal of Systems and Software
Core empirical concepts and skills for computer science
Proceedings of the 35th SIGCSE technical symposium on Computer science education
Why Evaluate Ontology Technologies? Because It Works!
IEEE Intelligent Systems
Teaching empirical skills and concepts in computer science using random walks
Proceedings of the 36th SIGCSE technical symposium on Computer science education
Communications of the ACM - Transforming China
Proceedings of the 27th international conference on Software engineering
Experimental context classification: incentives and experience of subjects
Proceedings of the 27th international conference on Software engineering
REBSE '05 Proceedings of the 2005 workshop on Realising evidence-based software engineering
A Survey of Controlled Experiments in Software Engineering
IEEE Transactions on Software Engineering
The impact of software engineering research on modern progamming languages
ACM Transactions on Software Engineering and Methodology (TOSEM)
On the success of empirical studies in the international conference on software engineering
Proceedings of the 28th international conference on Software engineering
Proceedings of the 2006 ACM/IEEE international symposium on Empirical software engineering
On the usage and usefulness of OO design principles
Companion to the 21st ACM SIGPLAN symposium on Object-oriented programming systems, languages, and applications
Ethnographically-informed empirical studies of software practice
Information and Software Technology
The Future of Empirical Methods in Software Engineering Research
FOSE '07 2007 Future of Software Engineering
Synthetic designs: a new form of true experimental design for use in information systems development
Proceedings of the 2007 ACM SIGMETRICS international conference on Measurement and modeling of computer systems
A Systematic Review of Theory Use in Software Engineering Experiments
IEEE Transactions on Software Engineering
ACoM '07 Proceedings of the First International Workshop on Assessment of Contemporary Modularization Techniques
CABSYDD: Case-Based System for Database Design
Journal of Management Information Systems
Toward an experiment engine for lightweight grids
Proceedings of the first international conference on Networks for grid applications
Comparing software metrics tools
ISSTA '08 Proceedings of the 2008 international symposium on Software testing and analysis
Software engineering article types: An analysis of the literature
Journal of Systems and Software
Proceedings of the Second ACM-IEEE international symposium on Empirical software engineering and measurement
Middleware Support for Performance Improvement of MABS Applications in the Grid Environment
Multi-Agent-Based Simulation VIII
The profession of IT: Is software engineering engineering?
Communications of the ACM - Being Human in the Digital Age
Empirical evaluation in Computer Science research published by ACM
Information and Software Technology
Guidelines for conducting and reporting case study research in software engineering
Empirical Software Engineering
Design doctorate in computing: a defence of "doing cool stuff"
Proceedings of the 2009 Annual Conference of the Southern African Computer Lecturers' Association
A Case Study of Defect Introduction Mechanisms
CAiSE '09 Proceedings of the 21st International Conference on Advanced Information Systems Engineering
What you don't see can hurt you: adventures using library-provided data structures
Journal of Computing Sciences in Colleges
3rd workshop on assessment of contemporary modularization techniques (ACoM 2009)
Proceedings of the 24th ACM SIGPLAN conference companion on Object oriented programming systems languages and applications
Automatic frame extraction for improving content-based image retrieval of historical photographs
Proceedings of the 14th Brazilian Symposium on Multimedia and the Web
Computational Epistemology and e-Science: A New Way of Thinking
Minds and Machines
ESEM '09 Proceedings of the 2009 3rd International Symposium on Empirical Software Engineering and Measurement
Regenerative systems: challenges and opportunities for modeling, simulation, and visualization
Proceedings of the Fourth International ICST Conference on Performance Evaluation Methodologies and Tools
Editorial: Evaluation and Assessment in Software Engineering (EASE 05)
Information and Software Technology
Knowledge acquisition in software engineering requires sharing of data and artifacts
Proceedings of the 2006 international conference on Empirical software engineering issues: critical assessment and future directions
Documenting theories working group results
Proceedings of the 2006 international conference on Empirical software engineering issues: critical assessment and future directions
Dependability metrics
Proceedings of the ACM international conference on Object oriented programming systems languages and applications
Faith, hope, and love: an essay on software science's neglect of human factors
Proceedings of the ACM international conference on Object oriented programming systems languages and applications
Validity concerns in software engineering research
Proceedings of the FSE/SDP workshop on Future of software engineering research
Designing and prototyping dynamic software product lines: techniques and guidelines
SPLC'10 Proceedings of the 14th international conference on Software product lines: going beyond
Information and Software Technology
Computer science can use more science
Communications of the ACM
Impact of test-driven development on productivity, code and tests: A controlled experiment
Information and Software Technology
Proceedings of the First Workshop on Building Analysis Datasets and Gathering Experience Returns for Security
Design science in information systems research
MIS Quarterly
Towards a benchmark for traceability
Proceedings of the 12th International Workshop on Principles of Software Evolution and the 7th annual ERCIM Workshop on Software Evolution
Should security researchers experiment more and draw more inferences?
CSET'11 Proceedings of the 4th conference on Cyber security experimentation and test
Computing as a Science: A Survey of Competing Viewpoints
Minds and Machines
About theory in software development
GAVTASC'11 Proceedings of the 11th WSEAS international conference on Signal processing, computational geometry and artificial vision, and Proceedings of the 11th WSEAS international conference on Systems theory and scientific computation
Formal modeling and analysis of timed systems: technology push or market pull?
FORMATS'11 Proceedings of the 9th international conference on Formal modeling and analysis of timed systems
A literate experimentation manifesto
Proceedings of the 10th SIGPLAN symposium on New ideas, new paradigms, and reflections on programming and software
Proceedings of the 3rd ACM SIGPLAN workshop on Evaluation and usability of programming languages and tools
Pair programming vs. side-by-side programming
EuroSPI'05 Proceedings of the 12th European conference on Software Process Improvement
The case of the duplicate documents measurement, search, and science
APWeb'06 Proceedings of the 8th Asia-Pacific Web conference on Frontiers of WWW Research and Development
Replication of software engineering experiments
Empirical Software Engineering and Verification
Sustainability modelling and reporting: From roadmap to implementation
Decision Support Systems
MSEPT'12 Proceedings of the 2012 international conference on Multicore Software Engineering, Performance, and Tools
Dynamic adaptive search based software engineering
Proceedings of the ACM-IEEE international symposium on Empirical software engineering and measurement
Program comprehension in preprocessor-based software
SAFECOMP'12 Proceedings of the 2012 international conference on Computer Safety, Reliability, and Security
ESEML: empirical software engineering modeling language
Proceedings of the 2012 workshop on Domain-specific modeling
Seven pitfalls in modeling and simulation research
Proceedings of the Winter Simulation Conference
Information and Software Technology
Introducing computing students to scientific experimentation
Proceedings of the 18th ACM conference on Innovation and technology in computer science education
DataMill: rigorous performance evaluation made easy
Proceedings of the 4th ACM/SPEC International Conference on Performance Engineering
Our troubles with Linux Kernel upgrades and why you should care
ACM SIGOPS Operating Systems Review
Do background colors improve program comprehension in the #ifdef hell?
Empirical Software Engineering
Hi-index | 4.12 |
Do computer scientists need to experiment at all? Only if the answer is "yes" does it make sense to ask whether there is enough of it. The author argues that experimentation is central to the scientific process. Only experiments test theories. Only experiments can explore critical factors and bring new phenomena to light, so theories can be formulated and corrected. Without experiments, according to the author, computer science is in danger of drying up and becoming an auxiliary discipline. The current pressure to concentrate on application is the writing on the wall. The author rebuts the eight most common objections computer scientists have to focusing on experimentation: The traditional scientific method isn't applicable. The current level of experimentation is good enough. Experiments cost too much. Demonstrations will suffice. There's too much noise in the way. Progress will slow. Technology changes too fast. You'll never get it published.In contrast, the author argues that experimentation would build a reliable base of knowledge and thus reduce uncertainty about which theories, methods, and tools are adequate; lead to new, useful, and unexpected insights and open whole new areas of investigation; and accelerate progress by quickly eliminating fruitless approaches, erroneous assumptions, and fads. Conversely, when we ignore experimentation and avoid contact with reality, we hamper progress. As computer science leaves adolescence behind, the author advocates the development of its experimental branch.