Explicative document reading controlled by non-speech audio gestures

  • Authors:
  • Adam J. Sporka;Pavel Žikovský;Pavel Slavík

  • Affiliations:
  • Department of Computer Science and Engineering, Czech Technical University in Prague, Faculty of Electrical Engineering, Praha 2, Czech Republic;Musical Acoustics Research Centre, Music Faculty, Academy of Performing Arts in Prague, Praha 1, Czech Republic;Department of Computer Science and Engineering, Czech Technical University in Prague, Faculty of Electrical Engineering, Praha 2, Czech Republic

  • Venue:
  • TSD'06 Proceedings of the 9th international conference on Text, Speech and Dialogue
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

There are many situations in which listening to a text produced by a text-to-speech system is easier or safer than reading, for example when driving a car Technical documents, such as conference articles, manuals etc., usually are comprised of relatively plain and unequivocal sentences These documents usually contain words and terms unknown to the listener because they are full of domain specific terminology In this paper, we propose a system that allows the users to interrupt the reading upon hearing an unknown or confusing term by a non-speech acoustic gesture (e.g “uhm?”) Upon this interruption, the system provides a definition of the term, retrieved from Wikipedia, the Free Encyclopedia The selection of the non-speech gestures has been made with a respect to the cross-cultural applicability and language independence In this paper we present a set of novel tools enabling this kind of interaction.