ADL: exploring the middle ground between STRIPS and the situation calculus
Proceedings of the first international conference on Principles of knowledge representation and reasoning
Building user interfaces interactively using pre- and postconditions
CHI '92 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Specification-based test oracles for reactive systems
ICSE '92 Proceedings of the 14th international conference on Software engineering
An integrated general purpose automated test environment
ISSTA '93 Proceedings of the 1993 ACM SIGSOFT international symposium on Software testing and analysis
Generating a test oracle from program documentation: work in progress
ISSTA '94 Proceedings of the 1994 ACM SIGSOFT international symposium on Software testing and analysis
TAOS: Testing with Analysis and Oracle Support
ISSTA '94 Proceedings of the 1994 ACM SIGSOFT international symposium on Software testing and analysis
TOBAC: a test case browser for testing object-oriented software
ISSTA '94 Proceedings of the 1994 ACM SIGSOFT international symposium on Software testing and analysis
Oracles for checking temporal properties of concurrent systems
SIGSOFT '94 Proceedings of the 2nd ACM SIGSOFT symposium on Foundations of software engineering
Generating oracles from your favorite temporal logic specifications
SIGSOFT '96 Proceedings of the 4th ACM SIGSOFT symposium on Foundations of software engineering
Strategic directions in human-computer interaction
ACM Computing Surveys (CSUR) - Special ACM 50th-anniversary issue: strategic directions in computing research
Specification-based testing of reactive software: tools and experiments: experience report
ICSE '97 Proceedings of the 19th international conference on Software engineering
CHI '94 Conference Companion on Human Factors in Computing Systems
A visual test development environment for GUI systems
Proceedings of the 1998 ACM SIGSOFT international symposium on Software testing and analysis
Using a goal-driven approach to generate test cases for GUIs
Proceedings of the 21st international conference on Software engineering
Lutess: a specification-driven testing environment for synchronous software
Proceedings of the 21st international conference on Software engineering
Experience in Testing the Motif Interface
IEEE Software
A Method to Automate User Interface Testing Using Variable Finite State Machines
FTCS '97 Proceedings of the 27th International Symposium on Fault-Tolerant Computing (FTCS '97)
Why are Human-Computer interfaces Difficult to Design and Implement?
Why are Human-Computer interfaces Difficult to Design and Implement?
Integrating the MVC Paradigm into an Object-Oriented Framework to Accelerate GUI Application Development
The design of graphical user interfaces
The design of graphical user interfaces
A scalable formal method for design and automatic checking of user interfaces
ICSE '01 Proceedings of the 23rd International Conference on Software Engineering
Coverage criteria for GUI testing
Proceedings of the 8th European software engineering conference held jointly with 9th ACM SIGSOFT international symposium on Foundations of software engineering
Assertions to better specify the amazon bug
SEKE '02 Proceedings of the 14th international conference on Software engineering and knowledge engineering
AI Planner Assisted Test Generation
Software Quality Control
Proceedings of the 9th European software engineering conference held jointly with 11th ACM SIGSOFT international symposium on Foundations of software engineering
An examination of the run-time performance of GUI creation frameworks
PPPJ '03 Proceedings of the 2nd international conference on Principles and practice of programming in Java
Using Transient/Persistent Errors to Develop Automated Test Oracles for Event-Driven Software
Proceedings of the 19th IEEE international conference on Automated software engineering
A scalable formal method for design and automatic checking of user interfaces
ACM Transactions on Software Engineering and Methodology (TOSEM)
Automating regression testing for evolving GUI software: Research Articles
Journal of Software Maintenance and Evolution: Research and Practice - 2003 International Conference on Software Maintenance: The Architectural Evolution of Systems
Automated replay and failure detection for web applications
Proceedings of the 20th IEEE/ACM international Conference on Automated software engineering
Towards minimization of test sets for human-computer systems
IEA/AIE'2005 Proceedings of the 18th international conference on Innovations in Applied Artificial Intelligence
An introspective approach to marking graphical user interfaces
Proceedings of the 11th annual SIGCSE conference on Innovation and technology in computer science education
An empirical comparison between direct and indirect test result checking approaches
Proceedings of the 3rd international workshop on Software quality assurance
Designing and comparing automated test oracles for GUI-based software applications
ACM Transactions on Software Engineering and Methodology (TOSEM)
A practical approach to testing GUI systems
Empirical Software Engineering
Model-based User Interface Testing With Spec Explorer and ConcurTaskTrees
Electronic Notes in Theoretical Computer Science (ENTCS)
Challenges and opportunities for improving code-based testing of graphical user interfaces
Journal of Computational Methods in Sciences and Engineering - Selected papers from the International Conference on Computer Science, Software Engineering, Information Technology, e-Business, and Applications, 2004
Automatically repairing event sequence-based GUI test suites for regression testing
ACM Transactions on Software Engineering and Methodology (TOSEM)
Using a pilot study to derive a GUI model for automated testing
ACM Transactions on Software Engineering and Methodology (TOSEM)
Journal of Systems and Software
Design and analysis of GUI test-case prioritization using weight-based methods
Journal of Systems and Software
Reverse engineered formal models for GUI testing
FMICS'07 Proceedings of the 12th international conference on Formal methods for industrial critical systems
Model-based testing of multiple GUI variants using the GUI test generator
Proceedings of the 5th Workshop on Automation of Software Test
Automatically generating predicates and solutions for configuration troubleshooting
USENIX'09 Proceedings of the 2009 conference on USENIX Annual technical conference
An automated framework for software test oracle
Information and Software Technology
Specifying a testing oracle for train stations
Proceedings of the 8th International Workshop on Model-Driven Engineering, Verification and Validation
Minimal spanning set for coverage testing of interactive systems
ICTAC'04 Proceedings of the First international conference on Theoretical Aspects of Computing
Augmenting automatically generated unit-test suites with regression oracle checking
ECOOP'06 Proceedings of the 20th European conference on Object-Oriented Programming
Artificial neural networks as multi-networks automated test oracle
Automated Software Engineering
Specifying a testing oracle for train stations --- going beyond with product line technology
MODELS'11 Proceedings of the 2011th international conference on Models in Software Engineering
Testing android apps through symbolic execution
ACM SIGSOFT Software Engineering Notes
Modeling, analysis and testing of safety issues: an event-based approach and case study
SAFECOMP'07 Proceedings of the 26th international conference on Computer Safety, Reliability, and Security
Automated concolic testing of smartphone apps
Proceedings of the ACM SIGSOFT 20th International Symposium on the Foundations of Software Engineering
Automated generation of test oracles using a model-driven approach
Information and Software Technology
Automatically repairing broken workflows for evolving GUI applications
Proceedings of the 2013 International Symposium on Software Testing and Analysis
Dynodroid: an input generation system for Android apps
Proceedings of the 2013 9th Joint Meeting on Foundations of Software Engineering
Graphical user interface (GUI) testing: Systematic mapping and repository
Information and Software Technology
Hi-index | 0.01 |
Graphical User Interfaces (GUIs) are critical components of today's software. Because GUIs have different characteristics than traditional software, conventional testing techniques do not apply to GUI software. In previous work, we presented an approach to generate GUI test cases, which take the form of sequences of actions. In this paper we develop a test oracle technique to determine if a GUI behaves as expected for a given test case. Our oracle uses a formal model of a GUI, expressed as sets of objects, object properties, and actions. Given the formal model and a test case, our oracle automatically derives the expected state for every action in the test case. We represent the actual state of an executing GUI in terms of objects and their properties derived from the GUI's execution. Using the actual state acquired from an execution monitor, our oracle automatically compares the expected and actual states after each action to verify the correctness of the GUI for the test case. We implemented the oracle as a component in our GUI testing system, called Planning Assisted Tester for grapHical user interface Systems (PATHS), which is based on AI planning. We experimentally evaluated the practicality and effectiveness of our oracle technique and report on the results of experiments to test and verify the behavior of our version of the Microsoft WordPad's GUI.