Using GOMS for user interface design and evaluation: which technique?
ACM Transactions on Computer-Human Interaction (TOCHI)
A safe, efficient regression test selection technique
ACM Transactions on Software Engineering and Methodology (TOSEM)
Hierarchical GUI Test Case Generation Using Automated Planning
IEEE Transactions on Software Engineering - Special issue on 1999 international conference on software engineering
Coverage criteria for GUI testing
Proceedings of the 8th European software engineering conference held jointly with 9th ACM SIGSOFT international symposium on Foundations of software engineering
Software Testing Techniques
The Psychology of Human-Computer Interaction
The Psychology of Human-Computer Interaction
The bloodhound project: automating discovery of web usability issues using the InfoScentπ simulator
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Finite-State Testing and Analysis of Graphical User Interfaces
ISSRE '01 Proceedings of the 12th International Symposium on Software Reliability Engineering
Proceedings of the 9th European software engineering conference held jointly with 11th ACM SIGSOFT international symposium on Foundations of software engineering
GUI Ripping: Reverse Engineering of Graphical User Interfaces for Testing
WCRE '03 Proceedings of the 10th Working Conference on Reverse Engineering
Predictive human performance modeling made easy
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Proceedings of the 27th international conference on Software engineering
A framework for measurement based performance modeling
WOSP '08 Proceedings of the 7th international workshop on Software and performance
Proceedings of the eighteenth international symposium on Software testing and analysis
GUI testing using computer vision
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Proceedings of the 33rd International Conference on Software Engineering
CogTool-Explorer: a model of goal-directed user exploration that considers information layout
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Easing the generation of predictive human performance models from legacy systems
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Hi-index | 0.00 |
As software systems evolve, new interface features such as keyboard shortcuts and toolbars are introduced. While it is common to regression test the new features for functional correctness, there has been less focus on systematic regression testing for usability, due to the effort and time involved in human studies. Cognitive modeling tools such as CogTool provide some help by computing predictions of user performance, but they still require manual effort to describe the user interface and tasks, limiting regression testing efforts. In recent work, we developed CogTool Helper to reduce the effort required to generate human performance models of existing systems. We build on this work by providing task specific test case generation and present our vision for human performance regression testing (HPRT) that generates large numbers of test cases and evaluates a range of human performance predictions for the same task. We examine the feasibility of HPRT on four tasks in LibreOffice, find several regressions, and then discuss how a project team could use this information. We also illustrate that we can increase efficiency with sampling by leveraging an inference algorithm. Samples that take approximately 50% of the runtime lose at most 10% of the performance predictions.