Face-to-face interaction and the KTH cooking show

  • Authors:
  • Jonas Beskow;Jens Edlund;Björn Granström;Joakim Gustafson;David House

  • Affiliations:
  • KTH Speech Music and Hearing/Centre for Speech Technology, Stockholm, Sweden;KTH Speech Music and Hearing/Centre for Speech Technology, Stockholm, Sweden;KTH Speech Music and Hearing/Centre for Speech Technology, Stockholm, Sweden;KTH Speech Music and Hearing/Centre for Speech Technology, Stockholm, Sweden;KTH Speech Music and Hearing/Centre for Speech Technology, Stockholm, Sweden

  • Venue:
  • COST'09 Proceedings of the Second international conference on Development of Multimodal Interfaces: active Listening and Synchrony
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

We share our experiences with integrating motion capture recordings in speech and dialogue research by describing (1) Spontal, a large project collecting 60 hours of video, audio and motion capture spontaneous dialogues, is described with special attention to motion capture and its pitfalls; (2) a tutorial where we use motion capture, speech synthesis and an animated talking head to allow students to create an active listener; and (3) brief preliminary results in the form of visualizations of motion capture data over time in a Spontal dialogue. We hope that given the lack of writings on the use of motion capture for speech research, these accounts will prove inspirational and informative.