Towards Fine-Grained Usability Testing: New Methodological Directions with Conversation Analysis

  • Authors:

  • Marko Nieminen;Sari Karjalainen;Sirpa Riihiaho;Petri Mannonen

  • Affiliations:

  • Department of Computer Science and Engineering, Helsinki University of Technology, Espoo, Finland;Department of Speech Sciences, University of Helsinki, Helsinki, Finland;Department of Computer Science and Engineering, Helsinki University of Technology, Espoo, Finland;Department of Computer Science and Engineering, Helsinki University of Technology, Espoo, Finland

  • Venue:
  • HCD 09 Proceedings of the 1st International Conference on Human Centered Design: Held as Part of HCI International 2009
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

We examine the possibilities of conversation analysis (CA) in usability testing. The goal is to examine how usability test setups serve as source for the CA analysis. We used video data from two earlier usability tests. Our results indicate that traditional test setup does not serve as a sufficient source for CA. The actions in the user interface were unclear, the user's facial reactions were not visible, and the user is occasionally having more conversation with the moderator than the system. CA approach can be taken towards two separate directions regarding usability tests: Analysis can be focused to the dialogue between the moderator and the user or on the user-system interaction. There is a need to fine-tune data gathering with detailed level recording of keypresses and system outputs. However, CA-enhanced usability testing allows in-depth analysis of usability problems as well as analysis of holistic interaction between user and system.