Usability inspection methods
Usability in the real world: assessing medical information technologies in patient's homes
Journal of Biomedical Informatics - Patient safety
Cognitive and usability engineering methods for the evaluation of clinical information systems
Journal of Biomedical Informatics
Using qualitative studies to improve the usability of an EMR
Journal of Biomedical Informatics - Special issue: Human-centered computing in health information systems. Part 1: Analysis and design
Human-Centered Software Engineering - Integrating Usability in the Development Process (Human-Computer Interaction Series)
Journal of Biomedical Informatics - Special issue: Human-centered computing in health information systems. Part 2: Evaluation
Current practice in measuring usability: Challenges to usability studies and research
International Journal of Human-Computer Studies
The FaceReader: measuring instant fun of use
Proceedings of the 4th Nordic conference on Human-computer interaction: changing roles
Measuring emotional valence to understand the user's experience of software
International Journal of Human-Computer Studies
Physicians' Resistance toward Healthcare Information Technologies: A Dual-Factor Model
HICSS '07 Proceedings of the 40th Annual Hawaii International Conference on System Sciences
Damaged merchandise? a review of experiments that compare usability evaluation methods
Human-Computer Interaction
Scrutinising usability evaluation: does thinking aloud affect behaviour and mental workload?
Behaviour & Information Technology
The development and evaluation of a survey to measure user engagement
Journal of the American Society for Information Science and Technology
ICME'09 Proceedings of the 2009 IEEE international conference on Multimedia and Expo
Recognition of facial expressions and measurement of levels of interest from video
IEEE Transactions on Multimedia
UX_Mate: from facial expressions to UX evaluation
Proceedings of the Designing Interactive Systems Conference
| Hi-index | 0.00 |
Computer screen videos (CSVs) and users' facial expressions videos (FEVs) are recommended to evaluate systems performance. However, software combining both methods is often non-accessible in clinical research fields. The Observer-XT software is commonly used for clinical research to assess human behaviours. Thus, this study reports on the combination of CSVs and FEVs, to evaluate a graphical user interface (GUI). Eight physiotherapists entered clinical information in the GUI while CSVs and FEVs were collected. The frequency and duration of a list of behaviours found in FEVs were analysed using the Observer-XT-10.5. Simultaneously, the frequency and duration of usability problems of CSVs were manually registered. CSVs and FEVs timelines were also matched to verify combinations. The analysis of FEVs revealed that the category most frequently observed in users behaviour was the eye contact with the screen (ECS, 32+/-9) whilst verbal communication achieved the highest duration (14.8+/-6.9min). Regarding the CSVs, 64 problems, related with the interface (73%) and the user (27%), were found. In total, 135 usability problems were identified by combining both methods. The majority were reported through verbal communication (45.8%) and ECS (40.8%). ''False alarms'' and ''misses'' did not cause quantifiable reactions and the facial expressions problems were mainly related with the lack of familiarity (55.4%) felt by users when interacting with the interface. These findings encourage the use of Observer-XT-10.5 to conduct small usability sessions, as it identifies emergent groups of problems by combining methods. However, to validate final versions of systems further validation should be conducted using specialized software.