Value of Using Multimodal Data in HCI Methodologies

  • Authors:
  • Jhilmil Jain

  • Affiliations:
  • Hewlett-Packard Laboratories, Palo Alto, USA CA 94304

  • Venue:
  • Proceedings of the 13th International Conference on Human-Computer Interaction. Part II: Novel Interaction Methods and Techniques
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper, I will discuss two HCI methodologies, diary study and affinity diagramming, that were carried out using multimodal data such as images, audio, video, annotated media along with the traditional use of text. I will discuss a software solution that was developed at HP Labs to conduct a multimodal diary study using three touch points: PCs, mobile devices and any type of landline/cellular phone. This will be followed by a discussion on how Microsoft StickySorter software was used to conduct multimodal affinity diagramming exercises.