Cost/benefit analysis for incorporating human factors in the software lifecycle
Communications of the ACM
Improving a human-computer dialogue
Communications of the ACM
Usability engineering at a discount
Proceedings of the third international conference on human-computer interaction on Designing and using human-computer interfaces and knowledge based systems (2nd ed.)
Using the thinking-aloud method in system development
Proceedings of the third international conference on human-computer interaction on Designing and using human-computer interfaces and knowledge based systems (2nd ed.)
Heuristic evaluation of user interfaces
CHI '90 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
User interface evaluation in the real world: a comparison of four techniques
CHI '91 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
A cost-effective evaluation method for use by designers
International Journal of Man-Machine Studies
The Usability Engineering Life Cycle
Computer
Refining the test phase of usability evaluation: how many subjects is enough?
Human Factors - Special issue: measurement in human factors
The precis of Project Ernestine or an overview of a validation of GOMS
CHI '92 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Finding usability problems through heuristic evaluation
CHI '92 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Comparison of empirical testing and walkthrough methods in user interface evaluation
CHI '92 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Evaluating the thinking-aloud technique for use by computer scientists
Advances in human-computer interaction (vol. 3)
Usability inspection methods
Usability Engineering
Iterative User-Interface Design
Computer
Big Paybacks from 'Discount' Usability Engineering
IEEE Software
Integrated office software benchmarks: A case study
INTERACT '90 Proceedings of the IFIP TC13 Third Interational Conference on Human-Computer Interaction
Challenges of HCI design and implementation
interactions
CHI '95 Conference Companion on Human Factors in Computing Systems
Making a difference—the impact of inspections
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Strategic directions in human-computer interaction
ACM Computing Surveys (CSUR) - Special ACM 50th-anniversary issue: strategic directions in computing research
Practical usability evaluation
Conference Companion on Human Factors in Computing Systems
Practical usability evaluation
CHI '94 Conference Companion on Human Factors in Computing Systems
CHI '94 Conference Companion on Human Factors in Computing Systems
Digital talking books on a PC: a usability evaluation of the prototype DAISY playback software
Assets '98 Proceedings of the third international ACM conference on Assistive technologies
Methods & tools: participatory heuristic evaluation
interactions
The evaluator effect in usability tests
CHI 98 Cconference Summary on Human Factors in Computing Systems
Designing an e-commerce site for users
Crossroads
WebQuilt: a framework for capturing and visualizing the web experience
Proceedings of the 10th international conference on World Wide Web
WebQuilt: A proxy-based approach to remote web usability testing
ACM Transactions on Information Systems (TOIS)
Testing web sites: five users is nowhere near enough
CHI '01 Extended Abstracts on Human Factors in Computing Systems
Heuristic evaluation of ambient displays
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
The "magic number 5": is it enough for web testing?
CHI '03 Extended Abstracts on Human Factors in Computing Systems
An ethnographic approach to design
The human-computer interaction handbook
Les tests utilisateurs: avantages et inconvénients des passations individuelles et par paires
IHM '02 Proceedings of the 14th French-speaking conference on Human-computer interaction (Conférence Francophone sur l'Interaction Homme-Machine)
Usability of websites contributing to trust in e-commerce
Trust in knowledge management and systems in organizations
Proceedings of the third Nordic conference on Human-computer interaction
Modelling and measuring Collaborative Software Engineering
ACSC '05 Proceedings of the Twenty-eighth Australasian conference on Computer Science - Volume 38
Informing the design of pipeline-based software visualisations
APVis '05 proceedings of the 2005 Asia-Pacific symposium on Information visualisation - Volume 45
Comparison of think-aloud and constructive interaction in usability testing with children
Proceedings of the 2005 conference on Interaction design and children
Written versus spoken queries: A qualitative and quantitative comparative analysis
Journal of the American Society for Information Science and Technology - Research Articles
MPEG-7 in action: end user experiences with COSMOS-7 front end systems
Proceedings of the 2006 ACM symposium on Applied computing
Heuristic evaluations at bell labs: analyses of evaluator overlap and group session
CHI '07 Extended Abstracts on Human Factors in Computing Systems
Building up usability-engineering capability by improving access to automated usability evaluation
Interacting with Computers
Introducing item response theory for measuring usability inspection processes
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Designing and evaluating multimodal interaction for mobile contexts
ICMI '08 Proceedings of the 10th international conference on Multimodal interfaces
Understanding Collection Understanding with Collage
ICADL 08 Proceedings of the 11th International Conference on Asian Digital Libraries: Universal and Ubiquitous Access to Information
Undo and erase events as indicators of usability problems
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Usable secure mailing lists with untrusted servers
Proceedings of the 8th Symposium on Identity and Trust on the Internet
Using formal models to design user interfaces: a case study
BCS-HCI '07 Proceedings of the 21st British HCI Group Annual Conference on People and Computers: HCI...but not as we know it - Volume 1
Heterogeneity in the usability evaluation process
BCS-HCI '08 Proceedings of the 22nd British HCI Group Annual Conference on People and Computers: Culture, Creativity, Interaction - Volume 1
Controlling the usability evaluation process under varying defect visibility
Proceedings of the 23rd British HCI Group Annual Conference on People and Computers: Celebrating People and Technology
Better discount evaluation: illustrating how critical parameters support heuristic creation
Interacting with Computers
Interaction walkthrough: evaluation of safety critical interactive systems
DSVIS'06 Proceedings of the 13th international conference on Interactive systems: Design, specification, and verification
Developing usability studies via formal models of UIs
Proceedings of the 2nd ACM SIGCHI symposium on Engineering interactive computing systems
Using the hybrid simulation for early user evaluations of pervasive interactions
Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries
Discount user-centered e-health design: a quick-but-not-dirty method
USAB'10 Proceedings of the 6th international conference on HCI in work and learning, life and leisure: workgroup human-computer interaction and usability engineering
Conversational management of network trouble perturbations in personal videoconferencing
Proceedings of the 22nd Conference of the Computer-Human Interaction Special Interest Group of Australia on Computer-Human Interaction
Browsing museum image collections on a multi-touch table
Information Systems
A semantically enhanced service repository for user-centric service discovery and management
Data & Knowledge Engineering
Sample size in usability studies
Communications of the ACM
Backtracking Events as Indicators of Usability Problems in Creation-Oriented Applications
ACM Transactions on Computer-Human Interaction (TOCHI)
Refactoring legacy AJAX applications to improve the efficiency of the data exchange component
Journal of Systems and Software
Outliers in usability testing: how to treat usability problems found for only one test participant?
Proceedings of the 7th Nordic Conference on Human-Computer Interaction: Making Sense Through Design
Sirius: A heuristic-based framework for measuring web usability adapted to the type of website
Journal of Systems and Software
Attract me!: how could end-users identify interesting resources?
Proceedings of the 3rd International Conference on Web Intelligence, Mining and Semantics
Usability in designing assistive technology for children with learning disabilities
i-CREATe '11 Proceedings of the 5th International Conference on Rehabilitation Engineering & Assistive Technology
Performing and analyzing non-formal inspections of entity relationship diagram (ERD)
Journal of Systems and Software
SkyView: a user evaluation of the skyline operator
Proceedings of the 22nd ACM international conference on Conference on information & knowledge management
Reviewing and Extending the Five-User Assumption: A Grounded Procedure for Interaction Evaluation
ACM Transactions on Computer-Human Interaction (TOCHI)
Journal of Biomedical Informatics
AUIC '13 Proceedings of the Fourteenth Australasian User Interface Conference - Volume 139
A formative study of influences on student testing behaviors
Proceedings of the 45th ACM technical symposium on Computer science education
Technology and Health Care
Hi-index | 0.02 |
For 11 studies, we find that the detection of usability problems as a function of number of users tested or heuristic evaluators employed is well modeled as a Poisson process. The model can be used to plan the amount of evaluation required to achieve desired levels of thoroughness or benefits. Results of early tests can provide estimates of the number of problems left to be found and the number of additional evaluations needed to find a given fraction. With quantitative evaluation costs and detection values, the model can estimate the numbers of evaluations at which optimal cost/benefit ratios are obtained and at which marginal utility vanishes. For a “medium” example, we estimate that 16 evaluations would be worth their cost, with maximum benefit/cost ratio at four.