Toward automatic generation of novice user test scripts
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
RecPlay: a fully integrated practical record/replay system
ACM Transactions on Computer Systems (TOCS)
jRapture: A Capture/Replay tool for observation-based testing
Proceedings of the 2000 ACM SIGSOFT international symposium on Software testing and analysis
Hierarchical GUI Test Case Generation Using Automated Planning
IEEE Transactions on Software Engineering - Special issue on 1999 international conference on software engineering
Analysis and testing of Web applications
ICSE '01 Proceedings of the 23rd International Conference on Software Engineering
An Object-Oriented Architecture Supporting Web Application Testing
COMPSAC '99 23rd International Computer Software and Applications Conference
Improving web application testing with user session data
Proceedings of the 25th International Conference on Software Engineering
Object-Based Data Flow Testing of Web Applications
APAQS '00 Proceedings of the The First Asia-Pacific Conference on Quality Software (APAQS'00)
A Method to Automate User Interface Testing Using Variable Finite State Machines
FTCS '97 Proceedings of the 27th International Symposium on Fault-Tolerant Computing (FTCS '97)
Generating Test Cases for GUI Responsibilities Using Complete Interaction Sequences
ISSRE '00 Proceedings of the 11th International Symposium on Software Reliability Engineering
Structural Testing of Web Applications
ISSRE '00 Proceedings of the 11th International Symposium on Software Reliability Engineering
Finite-State Testing and Analysis of Graphical User Interfaces
ISSRE '01 Proceedings of the 12th International Symposium on Software Reliability Engineering
ICSM '02 Proceedings of the International Conference on Software Maintenance (ICSM'02)
Record/replay for nondeterministic program executions
Communications of the ACM - Why CS students need math
Agile regression testing using record & playback
OOPSLA '03 Companion of the 18th annual ACM SIGPLAN conference on Object-oriented programming, systems, languages, and applications
An approach to quantifying the run-time behaviour of Java GUI applications
WISICT '04 Proceedings of the winter international synposium on Information and communication technologies
Specification-driven automated testing of GUI-based Java programs
ACM-SE 42 Proceedings of the 42nd annual Southeast regional conference
BugNet: Continuously Recording Program Execution for Deterministic Replay Debugging
Proceedings of the 32nd annual international symposium on Computer Architecture
Leveraging User-Session Data to Support Web Application Testing
IEEE Transactions on Software Engineering
Automating regression testing for evolving GUI software: Research Articles
Journal of Software Maintenance and Evolution: Research and Practice - 2003 International Conference on Software Maintenance: The Architectural Evolution of Systems
Studying the Fault-Detection Effectiveness of GUI Test Cases for Rapidly Evolving Software
IEEE Transactions on Software Engineering
Developing cost-effective model-based techniques for GUI testing
Proceedings of the 28th international conference on Software engineering
The DaCapo benchmarks: java benchmarking development and analysis
Proceedings of the 21st annual ACM SIGPLAN conference on Object-oriented programming systems, languages, and applications
ExecRecorder: VM-based full-system replay for attack analysis and system recovery
Proceedings of the 1st workshop on Architectural and system support for improving software dependability
Designing and comparing automated test oracles for GUI-based software applications
ACM Transactions on Software Engineering and Methodology (TOSEM)
Effective GUI Testing Automation: Developing an Automated GUI Testing Tool
Effective GUI Testing Automation: Developing an Automated GUI Testing Tool
Using GUI Run-Time State as Feedback to Generate Test Cases
ICSE '07 Proceedings of the 29th international conference on Software Engineering
Test-Driven GUI Development with TestNG and Abbot
IEEE Software
A practical approach to testing GUI systems
Empirical Software Engineering
Experimenting with software testbeds for evaluating new technologies
Empirical Software Engineering
Statistically rigorous java performance evaluation
Proceedings of the 22nd annual ACM SIGPLAN conference on Object-oriented programming systems and applications
Automated gui testing guided by usage profiles
Proceedings of the twenty-second IEEE/ACM international conference on Automated software engineering
Call-Stack Coverage for GUI Test Suite Reduction
IEEE Transactions on Software Engineering
Test case generator for GUITAR
Companion of the 30th international conference on Software engineering
Relationships between Test Suites, Faults, and Fault Detection in GUI Testing
ICST '08 Proceedings of the 2008 International Conference on Software Testing, Verification, and Validation
State-Based Testing of Ajax Web Applications
ICST '08 Proceedings of the 2008 International Conference on Software Testing, Verification, and Validation
The Utilization of User Sessions in Testing
ICIS '08 Proceedings of the Seventh IEEE/ACIS International Conference on Computer and Information Science (icis 2008)
Measuring the performance of interactive applications with listener latency profiling
Proceedings of the 6th international symposium on Principles and practice of programming in Java
Automatically repairing event sequence-based GUI test suites for regression testing
ACM Transactions on Software Engineering and Methodology (TOSEM)
Using a pilot study to derive a GUI model for automated testing
ACM Transactions on Software Engineering and Methodology (TOSEM)
A case study-based comparison of web testing techniques applied to AJAX web applications
International Journal on Software Tools for Technology Transfer (STTT)
TAIC-PART '08 Proceedings of the Testing: Academic & Industrial Conference - Practice and Research Techniques
Producing wrong data without doing anything obviously wrong!
Proceedings of the 14th international conference on Architectural support for programming languages and operating systems
A generic library for GUI reasoning and testing
Proceedings of the 2009 ACM symposium on Applied Computing
An Initial Characterization of Industrial Graphical User Interface Systems
ICST '09 Proceedings of the 2009 International Conference on Software Testing Verification and Validation
An Extensible Heuristic-Based Framework for GUI Test Case Maintenance
ICSTW '09 Proceedings of the IEEE International Conference on Software Testing, Verification, and Validation Workshops
Towards Dynamic Adaptive Automated Test Generation for Graphical User Interfaces
ICSTW '09 Proceedings of the IEEE International Conference on Software Testing, Verification, and Validation Workshops
Live migration of virtual machine based on full system trace and replay
Proceedings of the 18th ACM international symposium on High performance distributed computing
Invariant-based automatic testing of AJAX user interfaces
ICSE '09 Proceedings of the 31st International Conference on Software Engineering
Maintaining and evolving GUI-directed test scripts
ICSE '09 Proceedings of the 31st International Conference on Software Engineering
Design and Implementation of GUI Automated Testing Framework Based on XML
WCSE '09 Proceedings of the 2009 WRI World Congress on Software Engineering - Volume 04
Model-Based Testing of GUI-Driven Applications
SEUS '09 Proceedings of the 7th IFIP WG 10.2 International Workshop on Software Technologies for Embedded and Ubiquitous Systems
Research Issues in the Automated Testing of Ajax Applications
SOFSEM '10 Proceedings of the 36th Conference on Current Trends in Theory and Practice of Computer Science
Generating Event Sequence-Based Test Cases Using GUI Runtime State Feedback
IEEE Transactions on Software Engineering
GUI testing using computer vision
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Successful automation of GUI driven acceptance testing
XP'03 Proceedings of the 4th international conference on Extreme programming and agile processes in software engineering
Evaluating the accuracy of Java profilers
PLDI '10 Proceedings of the 2010 ACM SIGPLAN conference on Programming language design and implementation
Automating performance testing of interactive Java applications
Proceedings of the 5th Workshop on Automation of Software Test
Model-based testing of multiple GUI variants using the GUI test generator
Proceedings of the 5th Workshop on Automation of Software Test
A Systematic Capture and Replay Strategy for Testing Complex GUI Based Java Applications
ITNG '10 Proceedings of the 2010 Seventh International Conference on Information Technology: New Generations
Proceedings of the 5th international symposium on Software visualization
Hi-index | 0.00 |
A significant body of prior work has devised approaches for automating the functional testing of interactive applications. However, little work exists for automatically testing their performance. Performance testing imposes additional requirements upon GUI test automation tools: the tools have to be able to replay complex interactive sessions, and they have to avoid perturbing the application's performance. We study the feasibility of using five Java GUI capture and replay tools for GUI performance test automation. Besides confirming the severity of the previously known GUI element identification problem, we also describe a related problem, the temporal synchronization problem, which is of increasing importance for GUI applications that use timer-driven activity. We find that most of the tools we study have severe limitations when used for recording and replaying realistic sessions of real-world Java applications and that all of them suffer from the temporal synchronization problem. However, we find that the most reliable tool, Pounder, causes only limited perturbation and thus can be used to automate performance testing. Based on an investigation of Pounder's approach, we further improve its robustness and reduce its perturbation. Finally, we demonstrate in a set of case studies that the conclusions about perceptible performance drawn from manual tests still hold when using automated tests driven by Pounder. Besides the significance of our findings to GUI performance testing, the results are also relevant to capture and replay-based functional GUI test automation approaches.