A multimodal interaction component for digital television

  • Authors:

  • Diogo Pedrosa;José Augusto C. Martins, Jr.;Erick L. Melo;Cesar A. C. Teixeira

  • Affiliations:

  • Universidade de São Paulo, São Carlos-SP, Brazil;Universidade de São Paulo, São Carlos-SP, Brazil;Universidade Federal de São Carlos, São Carlos-SP, Brazil;Universidade Federal de São Carlos, São Carlos-SP, Brazil

  • Venue:
  • Proceedings of the 2011 ACM Symposium on Applied Computing
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

In most current digital TV applications the user interaction takes place by pressing keys on a remote control. For simple applications this type of interaction is sufficient --- however, as interactive applications become more popular new input devices are demanded. After discussing motivating scenarios, this paper presents an architecture that offers to applications running on a set-top-box the possibility of receiving multimodal data (audio, video, image, ink, accelerometer, text, voice and customized data) from multiple devices (such as mobile phones, PDAs, tablet PCs, notebooks or even desktops). We validated the architecture by implementing a corresponding multimodal interaction component which extends the Brazilian Digital TV middleware, and by building applications which use the component.