Analyzing face and speech recognition to create automatic information for usability evaluation

• Authors: Thiago Adriano Coleti;Marcelo Morandini;Fátima de Lourdes dos Santos Nunes
• Venue: HCI'13 Proceedings of the 15th international conference on Human-Computer Interaction: human-centred design approaches, methods, tools, and environments - Volume Part I
• Year: 2013

Observe users perform their tasks in a software is an important way to performing usability evaluation due to the reason that provides real data about the interaction between user and system. Filming and verbalization are very used techniques and they must be a concern for all designers. However, the needs of reviewing all registered data manually became these techniques slow and difficult. This paper presents an approach that uses face recognition and speech processing to generate relevant information about a system under test such as what moments the user had specific reaction and which ones. The ErgoSV software supported the experiments that were performed using an e-commerce website. The results showed that this approach allows the evaluator identify interfaces with usability problems easily and quickly as well as present information using percentages that supported the evaluator making decision.