Physiological principles for the effective use of color
IEEE Computer Graphics and Applications
Selecting Software Test Data Using Data Flow Information
IEEE Transactions on Software Engineering
Compilers: principles, techniques, and tools
Compilers: principles, techniques, and tools
Axiomatizing software test data adequacy
IEEE Transactions on Software Engineering
The program dependence graph and its use in optimization
ACM Transactions on Programming Languages and Systems (TOPLAS)
An experimental study of people creating spreadsheets
ACM Transactions on Information Systems (TOIS)
An Applicable Family of Data Flow Testing Criteria
IEEE Transactions on Software Engineering
Elementary statistics
An Incremental Version of Iterative Data Flow Analysis
IEEE Transactions on Software Engineering
A Formal Evaluation of Data Flow Path Selection Criteria
IEEE Transactions on Software Engineering
Adequate testing and object-oriented programming
Journal of Object-Oriented Programming
An efficient hybrid algorithm for incremental data flow analysis
POPL '90 Proceedings of the 17th ACM SIGPLAN-SIGACT symposium on Principles of programming languages
Pointer-induced aliasing: a problem classification
POPL '91 Proceedings of the 18th ACM SIGPLAN-SIGACT symposium on Principles of programming languages
Graphical techniques in a spreadsheet for specifying user interfaces
CHI '91 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Incremental attribute evaluation: a flexible algorithm for lazy update
ACM Transactions on Programming Languages and Systems (TOPLAS)
Designing the user interface (2nd ed.): strategies for effective human-computer interaction
Designing the user interface (2nd ed.): strategies for effective human-computer interaction
A safe approximate algorithm for interprocedural aliasing
PLDI '92 Proceedings of the ACM SIGPLAN 1992 conference on Programming language design and implementation
Undecidability of static analysis
ACM Letters on Programming Languages and Systems (LOPLAS)
Selecting tests and identifying test coverage requirements for modified software
ISSTA '94 Proceedings of the 1994 ACM SIGSOFT international symposium on Software testing and analysis
Effect of test set minimization on fault detection effectiveness
Proceedings of the 17th international conference on Software engineering
An experimental evaluation of data flow and mutation testing
Software—Practice & Experience
A safe, efficient regression test selection technique
ACM Transactions on Software Engineering and Methodology (TOSEM)
Experiments of the effectiveness of dataflow- and controlflow-based test adequacy criteria
ICSE '94 Proceedings of the 16th international conference on Software engineering
Does continuous visual feedback aid debugging in direct-manipulation programming systems?
Proceedings of the ACM SIGCHI Conference on Human factors in computing systems
A spreadsheet approach to information visualization
Proceedings of the 10th annual ACM symposium on User interface software and technology
Graphical definitions: expanding spreadsheet languages through direct manipulation and gestures
ACM Transactions on Computer-Human Interaction (TOCHI)
What you see is what you test: a methodology for testing form-based visual programs
Proceedings of the 20th international conference on Software engineering
Slicing spreadsheets: an integrated methodology for spreadsheet testing and debugging
Proceedings of the 2nd conference on Domain-specific languages
Toward Visual Programming Languages for Steering Scientific Computations
IEEE Computational Science & Engineering
An Experimental Comparison of the Effectiveness of Branch Testing and Data Flow Testing
IEEE Transactions on Software Engineering
More Experience with Data Flow Testing
IEEE Transactions on Software Engineering
Spreadsheets on Trial: A Survey of Research on Spreadsheet Risks
HICSS '96 Proceedings of the 29th Hawaii International Conference on System Sciences Volume 2: Decision Support and Knowledge-Based Systems
Keyboardless Visual Programming Using Voice, Handwriting, and Gesture
VL '97 Proceedings of the 1997 IEEE Symposium on Visual Languages (VL '97)
Implementing Level 4 Liveness in Declarative Visual Programming Languages
VL '98 Proceedings of the IEEE Symposium on Visual Languages
Scaling Up a "What You See Is What You Test" Methodology to Spreadsheet Grids
VL '99 Proceedings of the IEEE Symposium on Visual Languages
Testing Strategies for Form-Based Visual Programs
ISSRE '97 Proceedings of the Eighth International Symposium on Software Reliability Engineering
AVI '96 Proceedings of the workshop on Advanced visual interfaces
A generalised spreadsheet verification methodology
ACSC '02 Proceedings of the twenty-fifth Australasian conference on Computer science - Volume 4
Testing Homogeneous Spreadsheet Grids with the "What You See Is What You Test" Methodology
IEEE Transactions on Software Engineering
Automated test case generation for spreadsheets
Proceedings of the 24th International Conference on Software Engineering
End-user software engineering with assertions in the spreadsheet paradigm
Proceedings of the 25th International Conference on Software Engineering
ICSM '01 Proceedings of the IEEE International Conference on Software Maintenance (ICSM'01)
Validating the Unit Correctness of Spreadsheet Programs
Proceedings of the 26th International Conference on Software Engineering
Communications of the ACM - End-user development: tools that empower users to create their own software solutions
Flow graphs for testing sequential erlang programs
ERLANG '04 Proceedings of the 2004 ACM SIGPLAN workshop on Erlang
Effectiveness of end-user debugging software features: are there gender issues?
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Automatic generation and maintenance of correct spreadsheets
Proceedings of the 27th international conference on Software engineering
An empirical study of fault localization for end-user programmers
Proceedings of the 27th international conference on Software engineering
An effective testing method for end-user programmers
WEUSE I Proceedings of the first workshop on End-user software engineering
WEUSE I Proceedings of the first workshop on End-user software engineering
Six challenges in supporting end-user debugging
WEUSE I Proceedings of the first workshop on End-user software engineering
Factors affecting the success of non-majors in learning to program
Proceedings of the first international workshop on Computing education research
ClassSheets: automatic generation of spreadsheet applications from object-oriented specifications
Proceedings of the 20th IEEE/ACM international Conference on Automated software engineering
Integrating automated test generation into the WYSIWYT spreadsheet testing methodology
ACM Transactions on Software Engineering and Methodology (TOSEM)
Gencel: a program generator for correct spreadsheets
Journal of Functional Programming
Inferring templates from spreadsheets
Proceedings of the 28th international conference on Software engineering
Type inference for spreadsheets
Proceedings of the 8th ACM SIGPLAN international conference on Principles and practice of declarative programming
An empirical evaluation of a testing and debugging methodology for Excel
Proceedings of the 2006 ACM/IEEE international symposium on Empirical software engineering
UCheck: A spreadsheet type checker for end users
Journal of Visual Languages and Computing
GoalDebug: A Spreadsheet Debugger for End Users
ICSE '07 Proceedings of the 29th international conference on Software Engineering
Model-Driven Quality Assurance for End Users
VLHCC '07 Proceedings of the IEEE Symposium on Visual Languages and Human-Centric Computing
A Type System Based on End-User Vocabulary
VLHCC '07 Proceedings of the IEEE Symposium on Visual Languages and Human-Centric Computing
Spreadsheet debugging behaviour of expert and novice end-users
Proceedings of the 4th international workshop on End-user software engineering
Unit-level test adequacy criteria for visual dataflow languages and a testing methodology
ACM Transactions on Software Engineering and Methodology (TOSEM)
Using assertions to help end-user programmers create dependable web macros
Proceedings of the 16th ACM SIGSOFT International Symposium on Foundations of software engineering
What Is End-User Software Engineering and Why Does It Matter?
IS-EUD '09 Proceedings of the 2nd International Symposium on End-User Development
Automatic detection of dimension errors in spreadsheets
Journal of Visual Languages and Computing
End-user software engineering and distributed cognition
SEEUP '09 Proceedings of the 2009 ICSE Workshop on Software Engineering Foundations for End User Programming
Interactive, visual fault localization support for end-user programmers
Journal of Visual Languages and Computing
The state of the art in end-user software engineering
ACM Computing Surveys (CSUR)
Where are my intelligent assistant's mistakes? a systematic testing approach
IS-EUD'11 Proceedings of the Third international conference on End-user development
Gender pluralism in problem-solving software
Interacting with Computers
Systematic evolution of model-based spreadsheet applications
Journal of Visual Languages and Computing
Lessons learned from evaluating the usability of mobile spreadsheet applications
HCSE'12 Proceedings of the 4th international conference on Human-Centered Software Engineering
Are Mobile Spreadsheet Applications Usable?
Journal of Organizational and End User Computing
Expert and Novice End-User Spreadsheet Debugging: A Comparative Study of Performance and Behaviour
Journal of Organizational and End User Computing
End-User Software Engineering and Why it Matters
Journal of Organizational and End User Computing
Debugging support for end user mashup programming
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
A web-centred approach to end-user software engineering
ACM Transactions on Software Engineering and Methodology (TOSEM) - Testing, debugging, and error handling, formal methods, lifecycle concerns, evolution and maintenance
Hi-index | 0.00 |
Spreadsheet languages, which include commercial spreadsheets and various research systems, have had a substantial impact on end-user computing. Research shows, however, that spreadsheets often contain faults; thus, we would like to provide at least some of the benefits of formal testing methodologies to the creators of spreadsheets. This article presents a testing methodology that adapts data flow adequacy criteria and coverage monitoring to the task of testing spreadsheets. To accommodate the evaluation model used with spreadsheets, and the interactive process by which they are created, our methodology is incremental. To accommodate the users of spreadsheet languages, we provide an interface to our methodology that does not require an understanding of testing theory. We have implemented our testing methodology in the context of the Forms/3 visual spreadsheet language. We report on the methodology, its time and space costs, and the mapping from the testing strategy to the user interface. In an empirical study, we found that test suites created according to our methodology detected, on average, 81% of the faults in a set of faulty spreadsheets, significantly outperforming randomly generated test suites.