Evaluation measures for interactive information retrieval
Information Processing and Management: an International Journal - Special issue on evaluation issues in information retrieval
Measuring usability: preference vs. performance
Communications of the ACM
ACM Transactions on Computer-Human Interaction (TOCHI)
Effects of awareness support on groupware usability
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
What can I say?: evaluating a spoken language interface to Email
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Time-compression: systems concerns, usage, and benefits
Proceedings of the SIGCHI conference on Human Factors in Computing Systems
The keystroke-level model for user performance time with interactive systems
Communications of the ACM
Usability Engineering
Deep realities: the fit of usability in business
ACM Journal of Computer Documentation (JCD)
Reading of electronic documents: the usability of linear, fisheye, and overview+detail interfaces
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Zazu: investigating the differences between experts and novices in using an advisory support tool
SAICSIT '02 Proceedings of the 2002 annual research conference of the South African institute of computer scientists and information technologists on Enablement through technology
User Testing a Hypermedia Tour Guide
IEEE Pervasive Computing
The human-computer interaction handbook
An empirical study of the effects of interactivity on web user attitude
International Journal of Human-Computer Studies
IEEE Transactions on Visualization and Computer Graphics
Master usability scaling: magnitude estimation and master scaling applied to usability measurement
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Proportional search interface usability measures
Proceedings of the third Nordic conference on Human-computer interaction
A method to standardize usability metrics into a single score
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Does time heal?: a longitudinal study of usability
OZCHI '05 Proceedings of the 17th Australia conference on Computer-Human Interaction: Citizens Online: Considerations for Today and the Future
Supporting problem identification in usability evaluations
OZCHI '05 Proceedings of the 17th Australia conference on Computer-Human Interaction: Citizens Online: Considerations for Today and the Future
Study of novice programmers using Eclipse and Gild
eclipse '05 Proceedings of the 2005 OOPSLA workshop on Eclipse technology eXchange
Current practice in measuring usability: Challenges to usability studies and research
International Journal of Human-Computer Studies
International Journal of Human-Computer Studies
Economic and subjective measures of the perceived value of aesthetics and usability
ACM Transactions on Computer-Human Interaction (TOCHI)
What users say they want in documentation
SIGDOC '06 Proceedings of the 24th annual ACM international conference on Design of communication
interactions - Waits & Measures
It's worth the hassle!: the added value of evaluating the usability of mobile systems in the field
Proceedings of the 4th Nordic conference on Human-computer interaction: changing roles
Online behaviors affected by spam
Social Science Computer Review
Towards optimal navigation through video content on interactive TV
Interacting with Computers
Usability of voting systems: baseline data for paper, punch cards, and lever machines
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Meta-analysis of correlations among usability measures
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Developing Quality through Measuring Usability--The UTUM Test Package
WoSQ '07 Proceedings of the 5th International Workshop on Software Quality
International Journal of Human-Computer Studies
Design Planning in End-User Web Development
VLHCC '07 Proceedings of the IEEE Symposium on Visual Languages and Human-Centric Computing
On the role of user-centred evaluation in the advancement of interactive information retrieval
Information Processing and Management: an International Journal
Controlling the complexity in comparing search user interfaces via user studies
Information Processing and Management: an International Journal
A usability comparison of three alternative message formats for an SMS banking service
International Journal of Human-Computer Studies
Tracing impact in a usability improvement process
Interacting with Computers
MoBiS-Q: a tool for evaluating the success of mobile business services
Proceedings of the 9th international conference on Human computer interaction with mobile devices and services
Supporting video library exploratory search: when storyboards are not enough
CIVR '08 Proceedings of the 2008 international conference on Content-based image and video retrieval
Usability and education of games through combined assessment methods
Proceedings of the 1st international conference on PErvasive Technologies Related to Assistive Environments
Analyses of user rationality and system learnability: performing task variants in user tests
Behaviour & Information Technology
Cognitive partnerships on the bench top: designing to support scientific researchers
Proceedings of the 7th ACM conference on Designing interactive systems
Effects of performance feedback on users' evaluations of an interactive IR system
Proceedings of the second international symposium on Information interaction in context
Exploring Factors That Make Online Interactive Games Successful: A Heuristic Approach
APCHI '08 Proceedings of the 8th Asia-Pacific conference on Computer-Human Interaction
Evaluation of ACTSim: A Composition Tool for Authoring Adaptive Soft Skill Simulations
AH '08 Proceedings of the 5th international conference on Adaptive Hypermedia and Adaptive Web-Based Systems
Integrating Planning and Dialogue in a Lifestyle Agent
IVA '08 Proceedings of the 8th international conference on Intelligent Virtual Agents
Behaviour & Information Technology
Improving web search transparency by using a Venn diagram interface
Proceedings of the 5th Nordic conference on Human-computer interaction: building bridges
International Journal of Human-Computer Studies
A Comprehensive Model of Usability
Engineering Interactive Systems
Accounting for diversity in subjective judgments
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Exploring potential usability gaps when switching mobile phones: an empirical study
BCS-HCI '07 Proceedings of the 21st British HCI Group Annual Conference on People and Computers: HCI...but not as we know it - Volume 1
Software operation time evaluation based on MTM
Advances in Engineering Software
Serial hook-ups: a comparative usability study of secure device pairing methods
Proceedings of the 5th Symposium on Usable Privacy and Security
Reliable Evaluation of Multimodal Dialogue Systems
Proceedings of the 13th International Conference on Human-Computer Interaction. Part II: Novel Interaction Methods and Techniques
Usability and User Acceptance for Personal Health Records: A Perspective from Healthcare Citizens
OCSC '09 Proceedings of the 3d International Conference on Online Communities and Social Computing: Held as Part of HCI International 2009
UWIS: An assessment methodology for usability of web-based information systems
Journal of Systems and Software
A comparative study of secure device pairing methods
Pervasive and Mobile Computing
COHSE: dynamic linking of web resources
COHSE: dynamic linking of web resources
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
On the vague modelling of web page characteristics regarding usability
AWIC'03 Proceedings of the 1st international Atlantic web intelligence conference on Advances in web intelligence
Modelling interacting web usability criteria through fuzzy measures
ICWE'03 Proceedings of the 2003 international conference on Web engineering
Human-centered design of interactive TV games with SMS backchannel
EuroITV'07 Proceedings of the 5th European conference on Interactive TV: a shared experience
From expert-driven to user-oriented communication of infection control guidelines
International Journal of Human-Computer Studies
HCI'07 Proceedings of the 12th international conference on Human-computer interaction: intelligent multimodal interaction environments
Quality of talking heads in different interaction and media contexts
Speech Communication
Measuring the usability of software applications: metrics for behaviorness
ICCSA'07 Proceedings of the 2007 international conference on Computational science and Its applications - Volume Part II
A review of factors influencing user satisfaction in information retrieval
Journal of the American Society for Information Science and Technology
Editorial: Modelling user experience - An agenda for research and practice
Interacting with Computers
Groupthink: usability of secure group association for wireless devices
Proceedings of the 12th ACM international conference on Ubiquitous computing
SPI success factors within product usability evaluation
Journal of Systems and Software
Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries
Evaluating multimodal systems: a comparison of established questionnaires and interaction parameters
Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries
A decision support system for usability evaluation of web-based information systems
Expert Systems with Applications: An International Journal
Testing usability of ERP open source systems
Proceedings of the Workshop on Open Source and Design of Communication
Usability Estimation of Software System by using Object-Oriented Metrics
ACM SIGSOFT Software Engineering Notes
Variation in importance of time-on-task with familiarity with mobile phone models
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Human-centered visualization environments
Human-centered visualization environments
In search of information on websites: a question of age?
UAHCI'11 Proceedings of the 6th international conference on Universal access in human-computer interaction: users diversity - Volume Part II
A comparative usability evaluation of traditional password managers
ICISC'10 Proceedings of the 13th international conference on Information security and cryptology
ACII'11 Proceedings of the 4th international conference on Affective computing and intelligent interaction - Volume Part I
Comparative evaluation of interfaces for presenting location-based information on mobile devices
ICADL'11 Proceedings of the 13th international conference on Asia-pacific digital libraries: for cultural heritage, knowledge dissemination, and future creation
Using concept hierarchies in text-based image retrieval: a user evaluation
CLEF'05 Proceedings of the 6th international conference on Cross-Language Evalution Forum: accessing Multilingual Information Repositories
QoSA'10 Proceedings of the 6th international conference on Quality of Software Architectures: research into Practice - Reality and Gaps
Proceedings of the 50th Annual Southeast Regional Conference
Exploring the quality in use of web 2.0 applications: the case of mind mapping services
ICWE'11 Proceedings of the 11th international conference on Current Trends in Web Engineering
An assessment of email and spontaneous dialog visualizations
International Journal of Human-Computer Studies
Computers in Human Behavior
USABILICS: avaliação remota de usabilidade e métricas baseadas na análise de tarefas
Proceedings of the 10th Brazilian Symposium on on Human Factors in Computing Systems and the 5th Latin American Conference on Human-Computer Interaction
Exploring the usability of web portals: A Croatian case study
International Journal of Information Management: The Journal for Information Professionals
How to assess human visual performance on an operational task
KES-AMSTA'12 Proceedings of the 6th KES international conference on Agent and Multi-Agent Systems: technologies and applications
Voice interactive classroom: best practices and design strategies
Concurrency and Computation: Practice & Experience
Questionnaires for evaluation in information visualization
Proceedings of the 2012 BELIV Workshop: Beyond Time and Errors - Novel Evaluation Methods for Visualization
Influence of personality on satisfaction with mobile phone services
ACM Transactions on Computer-Human Interaction (TOCHI)
Messaging to your doctors: understanding patient-provider communications via a portal system
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Human-machine interaction evaluation framework
HCI'13 Proceedings of the 15th international conference on Human-Computer Interaction: human-centred design approaches, methods, tools, and environments - Volume Part I
Creating test collections from user generated content for GIR evaluation
Proceedings of the 7th Workshop on Geographic Information Retrieval
Evaluating the perceived and estimated quality in use of Web 2.0 applications
Journal of Systems and Software
Hi-index | 0.01 |
Usability comprises the aspects effectiveness, efficiency, and satisfaction. The correlations between these aspects are not well understood for complex tasks. We present data from an experiment where 87 subjects solved 20 information retrieval tasks concerning programming problems. The correlation between efficiency, as indicated by task completion time, and effectiveness, as indicated by quality of solution, was negligible. Generally, the correlations among the usability aspects depend in a complex way on the application domain, the user's experience, and the use context. Going through three years of CHI Proceedings, we find that 11 out of 19 experimental studies involving complex tasks account for only one or two aspects of usability. When these studies make claims concerning overall usability, they rely on risky assumptions about correlations between usability aspects. Unless domain specific studies suggest otherwise, effectiveness, efficiency, and satisfaction should be considered independent aspect of usability and all be included in usability testing.