Improving a human-computer dialogue
Communications of the ACM
Cognitive dimensions of notations
Proceedings of the fifth conference of the British Computer Society, Human-Computer Interaction Specialist Group on People and computers V
Heuristic evaluation of user interfaces
CHI '90 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
User interface evaluation in the real world: a comparison of four techniques
CHI '91 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Refining the test phase of usability evaluation: how many subjects is enough?
Human Factors - Special issue: measurement in human factors
Cognitive walkthroughs: a method for theory-based evaluation of user interfaces
International Journal of Man-Machine Studies
Iterative methodology and designer training in human-computer interface design
Iterative methodology and designer training in human-computer interface design
Finding usability problems through heuristic evaluation
CHI '92 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
CHI '92 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Comparison of empirical testing and walkthrough methods in user interface evaluation
CHI '92 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
What is gained and lost when using evaluation methods other than empirical testing
HCI'92 Proceedings of the conference on People and computers VII
Iterative methodology and designer training in human-computer interface design
INTERCHI '93 Proceedings of the INTERCHI '93 conference on Human factors in computing systems
INTERCHI '93 Proceedings of the INTERCHI '93 conference on Human factors in computing systems
Usability inspection methods
The cognitive walkthrough method: a practitioner's guide
Usability inspection methods
Enhancing the explanatory power of usability heuristics
CHI '94 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Mapping the method muddle: guidance in using methods for user interface design
Proceedings of a workshop on Human-computer interface design : success stories, emerging methods, and real-world context: success stories, emerging methods, and real-world context
Exploration and experienced performance with display-based systems
Exploration and experienced performance with display-based systems
Turning research into practice: characteristics of display-based interaction
CHI '95 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Using GOMS for user interface design and evaluation: which technique?
ACM Transactions on Computer-Human Interaction (TOCHI)
The GOMS family of user interface analysis techniques: comparison and contrast
ACM Transactions on Computer-Human Interaction (TOCHI)
Toward a deeper comparison of methods: a reaction to Nielsen & Phillips and new data
CHI '94 Conference Companion on Human Factors in Computing Systems
Evaluating a multimedia authoring tool
Journal of the American Society for Information Science - Special issue on current research in human-computer interaction
Usability Engineering
The Psychology of Human-Computer Interaction
The Psychology of Human-Computer Interaction
Using GOMS for user interface design and evaluation: which technique?
ACM Transactions on Computer-Human Interaction (TOCHI)
On the contributions of different empirical data in usability testing
DIS '00 Proceedings of the 3rd conference on Designing interactive systems: processes, practices, methods, and techniques
Ignoring perfect knowledge in-the-world for imperfect knowledge in-the-head
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Proceedings of the second Nordic conference on Human-computer interaction
Heuristic evaluation of ambient displays
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
CHI '03 Extended Abstracts on Human Factors in Computing Systems
The human-computer interaction handbook
The human-computer interaction handbook
International Journal of Human-Computer Studies - Notification user interfaces
Evaluating usability methods: why the current literature fails the practitioner
interactions - The digital muse: HCI in support of creativity
Applying heuristics to perform a rigorous accessibility inspection in a commercial context
CUU '03 Proceedings of the 2003 conference on Universal usability
A model for notification systems evaluation—assessing user goals for multitasking activity
ACM Transactions on Computer-Human Interaction (TOCHI)
Modeling analyst performance for usability inspection
CHI '04 Extended Abstracts on Human Factors in Computing Systems
Applying user testing data to UEM performance metrics
CHI '04 Extended Abstracts on Human Factors in Computing Systems
Reconditioned merchandise: extended structured report formats in usability inspection
CHI '04 Extended Abstracts on Human Factors in Computing Systems
Comparative usability evaluation
Behaviour & Information Technology
Instant data analysis: conducting usability evaluations in a day
Proceedings of the third Nordic conference on Human-computer interaction
Analysis of strategies for improving and estimating the effectiveness of heuristic evaluation
Proceedings of the third Nordic conference on Human-computer interaction
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Comparing usability problems and redesign proposals as input to practical systems development
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Proceedings of the 6th conference on Information technology education
Comparison of think-aloud and constructive interaction in usability testing with children
Proceedings of the 2005 conference on Interaction design and children
Assessing usability and fun in educational software
Proceedings of the 2005 conference on Interaction design and children
The validity of the stimulated retrospective think-aloud method as measured by eye tracking
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Developpement d'un outil de mesure de l'utilisabilité des intranets
IHM '06 Proceedings of the 18th International Conferenceof the Association Francophone d'Interaction Homme-Machine
A method and advisor tool for multimedia user interface design
International Journal of Human-Computer Studies
How do design and evaluation interrelate in HCI research?
DIS '06 Proceedings of the 6th conference on Designing Interactive systems
It's worth the hassle!: the added value of evaluating the usability of mobile systems in the field
Proceedings of the 4th Nordic conference on Human-computer interaction: changing roles
Towards an empirical method of efficiency testing of system parts: A methodological study
Interacting with Computers
Evaluating experience-focused HCI
CHI '07 Extended Abstracts on Human Factors in Computing Systems
Increasing the impact of usability work in software development
CHI '07 Extended Abstracts on Human Factors in Computing Systems
Metaphors of human thinking for usability inspection and design
ACM Transactions on Computer-Human Interaction (TOCHI)
Tracing impact in a usability improvement process
Interacting with Computers
Building up usability-engineering capability by improving access to automated usability evaluation
Interacting with Computers
Introducing item response theory for measuring usability inspection processes
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
A comparative evaluation of heuristic-based usability inspection methods
CHI '08 Extended Abstracts on Human Factors in Computing Systems
Evaluating system utility and conceptual fit using CASSM
International Journal of Human-Computer Studies
Interacting with Computers
Evaluating usability of a commercial electronic health record: A case study
International Journal of Human-Computer Studies
A comparative test of web accessibility evaluation methods
Proceedings of the 10th international ACM SIGACCESS conference on Computers and accessibility
Understanding User Centred Design (UCD) for People with Special Needs
ICCHP '08 Proceedings of the 11th international conference on Computers Helping People with Special Needs
Beyond Conformance: The Role of Accessibility Evaluation Methods
WISE '08 Proceedings of the 2008 international workshops on Web Information Systems Engineering
Measuring Web Accessibility by Estimating Severity of Barriers
WISE '08 Proceedings of the 2008 international workshops on Web Information Systems Engineering
Comparative usability evaluation (CUE-4)
Behaviour & Information Technology
Introduction to this special issue on experimental comparisons of usability evaluation methods
Human-Computer Interaction
Let's stop pushing the envelope and start addressing it: a reference task agenda for HCI
Human-Computer Interaction
Considering Context and Users in Interactive Systems Analysis
Engineering Interactive Systems
Identifying Phenotypes and Genotypes: A Case Study Evaluating an In-Car Navigation System
Engineering Interactive Systems
The theoretical foundation and validity of a component-based usability questionnaire
Behaviour & Information Technology
HCI... not as it should be: inferential statistics in HCI research
BCS-HCI '07 Proceedings of the 21st British HCI Group Annual Conference on People and Computers: HCI...but not as we know it - Volume 1
A pattern-based usability inspection method: first empirical performance measures and future issues
BCS-HCI '07 Proceedings of the 21st British HCI Group Annual Conference on People and Computers: HCI...but not as we know it - Volume 2
Proceedings of the 2009 International Cross-Disciplinary Conference on Web Accessibililty (W4A)
Guideline aggregation: web accessibility evaluation for older users
Proceedings of the 2009 International Cross-Disciplinary Conference on Web Accessibililty (W4A)
IHM '07 Proceedings of the 19th International Conference of the Association Francophone d'Interaction Homme-Machine
Interaction engineering using the IVY tool
Proceedings of the 1st ACM SIGCHI symposium on Engineering interactive computing systems
Scenario-Based Methods for Evaluating Collaborative Systems
Computer Supported Cooperative Work
User-Centered Design and Evaluation --- The Big Picture
Proceedings of the 13th International Conference on Human-Computer Interaction. Part I: New Trends
Towards a Theory of Cultural Usability: A Comparison of ADA and CM-U Theory
HCD 09 Proceedings of the 1st International Conference on Human Centered Design: Held as Part of HCI International 2009
Evidence Based Design of Heuristics for Computer Assisted Assessment
INTERACT '09 Proceedings of the 12th IFIP TC 13 International Conference on Human-Computer Interaction: Part I
Is the `Figure of Merit' Really That Meritorious?
INTERACT '09 Proceedings of the 12th IFIP TC 13 International Conference on Human-Computer Interaction: Part I
Expert review method in game evaluations: comparison of two playability heuristic sets
Proceedings of the 13th International MindTrek Conference: Everyday Life in the Ubiquitous Era
Usability evaluation methods: mind the gaps
Proceedings of the 2009 Annual Research Conference of the South African Institute of Computer Scientists and Information Technologists
How much does expertise matter?: a barrier walkthrough study with experts and non-experts
Proceedings of the 11th international ACM SIGACCESS conference on Computers and accessibility
Generative walkthroughs: to support creative redesign
Proceedings of the seventh ACM conference on Creativity and cognition
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Validity and cross-validity in HCI publications
DSVIS'06 Proceedings of the 13th international conference on Interactive systems: Design, specification, and verification
Interaction walkthrough: evaluation of safety critical interactive systems
DSVIS'06 Proceedings of the 13th international conference on Interactive systems: Design, specification, and verification
Rapid and precise mobile data processing for fire brigades and rescue services (SAFeR/GÜTER/SHARE)
Proceedings of the 2007 conference on Human interface: Part II
UI-HCII'07 Proceedings of the 2nd international conference on Usability and internationalization
General interaction expertise: an approach for sampling in usability testing of consumer products
HCI'07 Proceedings of the 12th international conference on Human-computer interaction: interaction design and usability
The effects of human interaction on biometric system performance
ICDHM'07 Proceedings of the 1st international conference on Digital human modeling
Comparison of playtesting and expert review methods in mobile game evaluation
Proceedings of the 3rd International Conference on Fun and Games
Editorial: Modelling user experience - An agenda for research and practice
Interacting with Computers
Do patterns help novice evaluators? A comparative study
International Journal of Human-Computer Studies
SAICSIT '10 Proceedings of the 2010 Annual Research Conference of the South African Institute of Computer Scientists and Information Technologists
Critical review on video game evaluation heuristics: social games perspective
Futureplay '10 Proceedings of the International Academic Conference on the Future of Game Design and Technology
From human factors to human actors to human crafters
Proceedings of the 2011 iConference
Au-delà de l'utilisabilité: ordonner les composantes de la qualité de service en ligne
Conference Internationale Francophone sur I'Interaction Homme-Machine
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Usability evaluation methods for the web: A systematic mapping study
Information and Software Technology
International Journal of Human-Computer Studies
Discourse Variations Between Usability Tests and Usability Reports
Journal of Usability Studies
Quality and potential for adoption of usability evaluation methods: an empirical study on mile
Journal of Web Engineering
IS-EUD'11 Proceedings of the Third international conference on End-user development
Information Systems Frontiers
A usability-centred perspective on intention to use mobile payment
International Journal of Mobile Communications
Understanding of website usability: Specifying and measuring constructs and their relationships
Decision Support Systems
Web accessibility testing: when the method is the culprit
ICCHP'06 Proceedings of the 10th international conference on Computers Helping People with Special Needs
A structured expert evaluation method for the evaluation of children's computer games
INTERACT'05 Proceedings of the 2005 IFIP TC13 international conference on Human-Computer Interaction
Context of use evaluation of peripheral displays (CUEPD)
INTERACT'05 Proceedings of the 2005 IFIP TC13 international conference on Human-Computer Interaction
Municipalities on the web: user-friendliness of government information on the internet
EGOV'06 Proceedings of the 5th international conference on Electronic Government
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Rethinking statistical analysis methods for CHI
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Assessing the semiotic inspection method: the evaluators' perspective
Proceedings of the 11th Brazilian Symposium on Human Factors in Computing Systems
Empirical validation of a usability inspection method for model-driven Web development
Journal of Systems and Software
Analytic review of usability evaluation in ISMAR
Interacting with Computers
Analyzing the Influence of Web Site Design Parameters on Web Site Usability
Information Resources Management Journal
Journal of Organizational and End User Computing
Looking past yesterday's tomorrow: using futures studies methods to extend the research horizon
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Changing perspectives on evaluation in HCI: past, present, and future
CHI '13 Extended Abstracts on Human Factors in Computing Systems
A load of cobbler's children: beyond the model designing processor
CHI '13 Extended Abstracts on Human Factors in Computing Systems
Journal of Biomedical Informatics
Challenges for inclusive affective detection in educational scenarios
UAHCI'13 Proceedings of the 7th international conference on Universal Access in Human-Computer Interaction: design methods, tools, and interaction techniques for eInclusion - Volume Part I
Utilisabilité d'un Espace Personnel d'Information Modifiable par les Utilisateurs
Proceedings of the 25ième conférence francophone on l'Interaction Homme-Machine
Usability testing of a respiratory interface using computer screen and facial expressions videos
Computers in Biology and Medicine
Hi-index | 0.00 |
An interest in the design of interfaces has been a core topic for researchers and practitioners in the field of human-computer interaction (HCI); an interest in the design of experiments has not. To the extent that reliable and valid guidance for the former depends on the results of the latter, it is necessary that researchers and practitioners understand how small features of an experimental design can cast large shadows over the results and conclusions that can be drawn. In this review we examine the design of 5 experiments that compared usability evaluation methods (UEMs). Each has had an important influence on HCI thought and practice. Unfortunately, our examination shows that small problems in the way these experiments were designed and conducted call into serious question what we thought we knew regarding the efficacy of various UEMs. If the influence of these experiments were trivial, then such small problems could be safely ignored. Unfortunately, the outcomes of these experiments have been used to justify advice to practitioners regarding their choice of UEMs. Making such choices based on misleading or erroneous claims can be detrimental--compromising the quality and integrity of the evaluation, incurring unnecessary costs, or undermining the practitioner's credibility within the design team. The experimental method is a potent vehicle that can help inform the choice of a UEM as well as help to address other HCI issues. However, to obtain the desired outcomes, close attention must be paid to experimental design.