Toward automatic generation of novice user test scripts
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Does continuous visual feedback aid debugging in direct-manipulation programming systems?
Proceedings of the ACM SIGCHI Conference on Human factors in computing systems
Sage: creating reusable, modularized interactive behaviors by demonstration
CHI '94 Conference Companion on Human Factors in Computing Systems
A visual test development environment for GUI systems
Proceedings of the 1998 ACM SIGSOFT international symposium on Software testing and analysis
A visual medium for programmatic control of interactive applications
Proceedings of the SIGCHI conference on Human Factors in Computing Systems
Programming by example: visual generalization in programming by example
Communications of the ACM
GUI Testing: Pitfalls and Process
Computer
GUI Ripping: Reverse Engineering of Graphical User Interfaces for Testing
WCRE '03 Proceedings of the 10th Working Conference on Reverse Engineering
Designing the whyline: a debugging interface for asking questions about program behavior
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Designing and comparing automated test oracles for GUI-based software applications
ACM Transactions on Software Engineering and Methodology (TOSEM)
Aligning development tools with the way programmers think about code changes
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Koala: capture, share, automate, personalize business processes on the web
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Testing vs. code inspection vs. what else?: male and female end users' debugging strategies
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
CoScripter: automating & sharing how-to knowledge in the enterprise
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Finding causes of program output with the Java Whyline
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Sikuli: using GUI screenshots for search and automation
Proceedings of the 22nd annual ACM symposium on User interface software and technology
Enabling configuration-independent automation by non-expert users
OSDI'10 Proceedings of the 9th USENIX conference on Operating systems design and implementation
Content and hierarchy in pixel-based methods for reverse engineering interface structure
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Automated GUI performance testing
Software Quality Control
Using graphical representation of user interfaces as visual references
Proceedings of the 24th annual ACM symposium adjunct on User interface software and technology
Associating the visual representation of user interfaces with their internal structures and metadata
Proceedings of the 24th annual ACM symposium on User interface software and technology
Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces
Easing the generation of predictive human performance models from legacy systems
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Waken: reverse engineering usage information and interface structure from software videos
Proceedings of the 25th annual ACM symposium on User interface software and technology
Patina: dynamic heatmaps for visualizing application usage
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Software test automation using DEVSimPy environment
Proceedings of the 2013 ACM SIGSIM conference on Principles of advanced discrete simulation
Human performance regression testing
Proceedings of the 2013 International Conference on Software Engineering
Efficient and change-resilient test automation: an industrial case study
Proceedings of the 2013 International Conference on Software Engineering
Proceedings of the 2013 International Conference on Software Engineering
SeeSS: seeing what i broke -- visualizing change impact of cascading style sheets (css)
Proceedings of the 26th annual ACM symposium on User interface software and technology
Graphical user interface (GUI) testing: Systematic mapping and repository
Information and Software Technology
MenuInspector: Outil pour l'analyse des menus et cas d'étude
Proceedings of the 25ième conférence francophone on l'Interaction Homme-Machine
Proceedings of the 15th Workshop on Mobile Computing Systems and Applications
GUITAR: an innovative tool for automated testing of GUI-driven software
Automated Software Engineering
| Hi-index | 0.01 |
Testing a GUI's visual behavior typically requires human testers to interact with the GUI and to observe whether the expected results of interaction are presented. This paper presents a new approach to GUI testing using computer vision for testers to automate their tasks. Testers can write a visual test script that uses images to specify which GUI components to interact with and what visual feedback to be observed. Testers can also generate visual test scripts by demonstration. By recording both input events and screen images, it is possible to extract the images of components interacted with and the visual feedback seen by the demonstrator, and generate a visual test script automatically. We show that a variety of GUI behavior can be tested using this approach. Also, we show how this approach can facilitate good testing practices such as unit testing, regression testing, and test-driven development.