Development of an instrument measuring user satisfaction of the human-computer interface
CHI '88 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Usability—context, framework, definition, design and evaluation
Human factors for informatics usability
Measuring usability: preference vs. performance
Communications of the ACM
IBM computer usability satisfaction questionnaires: psychometric evaluation and instructions for use
International Journal of Human-Computer Interaction
The effect of computer experience on subjective and objective software usability measures
CHI '95 Conference Companion on Human Factors in Computing Systems
Assessing IT usage: the role of prior experience
MIS Quarterly
Self disclosure on computer forms: meta-analysis and implications
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Testing pointing device performance and user assessment with the ISO 9241, Part 9 standard
Proceedings of the SIGCHI conference on Human Factors in Computing Systems
Measuring usability: are effectiveness, efficiency, and satisfaction really correlated?
Proceedings of the SIGCHI conference on Human Factors in Computing Systems
Designing the User Interface: Strategies for Effective Human-Computer Interaction (4th Edition)
Designing the User Interface: Strategies for Effective Human-Computer Interaction (4th Edition)
Master usability scaling: magnitude estimation and master scaling applied to usability measurement
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
A method to standardize usability metrics into a single score
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Usability measurement and metrics: A consolidated model
Software Quality Control
Current practice in measuring usability: Challenges to usability studies and research
International Journal of Human-Computer Studies
The usability perspective framework
CHI '08 Extended Abstracts on Human Factors in Computing Systems
Effects of performance feedback on users' evaluations of an interactive IR system
Proceedings of the second international symposium on Information interaction in context
International Journal of Human-Computer Studies
Usability metric for mobile application: a goal question metric (GQM) approach
Proceedings of the 10th International Conference on Information Integration and Web-based Applications & Services
Non-universal usability?: a survey of how usability is understood by Chinese and Danish users
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Correlations among prototypical usability metrics: evidence for the construct of usability
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Challenges in evaluating usability and user experience of reality-based interaction
CHI '09 Extended Abstracts on Human Factors in Computing Systems
Reliable Evaluation of Multimodal Dialogue Systems
Proceedings of the 13th International Conference on Human-Computer Interaction. Part II: Novel Interaction Methods and Techniques
Cognitive load in ecommerce applications: measurement and effects on user satisfaction
Advances in Human-Computer Interaction
Sharing Usability Problem Sets within and between Groups
INTERACT '09 Proceedings of the 12th IFIP TC 13 International Conference on Human-Computer Interaction: Part II
Methods for Evaluating Interactive Information Retrieval Systems with Users
Foundations and Trends in Information Retrieval
ACM Transactions on Information Systems (TOIS)
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Editorial: Modelling user experience - An agenda for research and practice
Interacting with Computers
Measuring effectiveness of HCI integration in software development processes
Journal of Systems and Software
Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries
Evaluating multimodal systems: a comparison of established questionnaires and interaction parameters
Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries
The influence of the usage mode on subjectively perceived quality
IWSDS'10 Proceedings of the Second international conference on Spoken dialogue systems for ambient environments
USAB'10 Proceedings of the 6th international conference on HCI in work and learning, life and leisure: workgroup human-computer interaction and usability engineering
Variation in importance of time-on-task with familiarity with mobile phone models
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
The measurability and predictability of user experience
Proceedings of the 3rd ACM SIGCHI symposium on Engineering interactive computing systems
A Meta-Analytical Review of Empirical Mobile Usability Studies
Journal of Usability Studies
How voice augmentation supports elderly web users
The proceedings of the 13th international ACM SIGACCESS conference on Computers and accessibility
Exploring the usability of web portals: A Croatian case study
International Journal of Information Management: The Journal for Information Professionals
Empirical validation of a usability inspection method for model-driven Web development
Journal of Systems and Software
Influence of personality on satisfaction with mobile phone services
ACM Transactions on Computer-Human Interaction (TOCHI)
Emotions, experiences and usability in real-life mobile phone use
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Changing perspectives on evaluation in HCI: past, present, and future
CHI '13 Extended Abstracts on Human Factors in Computing Systems
Empirical evaluation of multimodal input interactions
HCI International'13 Proceedings of the 15th international conference on Human Interface and the Management of Information: information and interaction design - Volume Part I
| Hi-index | 0.01 |
Understanding the relation between usability measures seems crucial to deepen our conception of usability and to select the right measures for usability studies. We present a meta-analysis of correlations among usability measures calculated from the raw data of 73 studies. Correlations are generally low: effectiveness measures (e.g., errors) and efficiency measures (e.g., time) have a correlation of .247 ± .059 (Pearson's product-moment correlation with 95% confidence interval), efficiency and satisfaction (e.g., preference) one of .196 ± .064, and effectiveness and satisfaction one of .164 ± .062. Changes in task complexity do not influence these correlations, but use of more complex measures attenuates them. Standard questionnaires for measuring satisfaction appear more reliable than homegrown ones. Measures of users' perceptions of phenomena are generally not correlated with objective measures of the phenomena. Implications for how to measure usability are drawn and common models of usability are criticized.