Multimodal data communication for human-robot interactions

  • Authors:
  • Frank Wallhoff;Tobias Rehrl;Jürgen Gast;Alexander Bannat;Gerhard Rigoll

  • Affiliations:
  • Human-Machine Communication, Department of Electrical Engineering and Information Technologies, Technische Universität München, Munich, Germany;Human-Machine Communication, Department of Electrical Engineering and Information Technologies, Technische Universität München, Munich, Germany;Human-Machine Communication, Department of Electrical Engineering and Information Technologies, Technische Universität München, Munich, Germany;Human-Machine Communication, Department of Electrical Engineering and Information Technologies, Technische Universität München, Munich, Germany;Human-Machine Communication, Department of Electrical Engineering and Information Technologies, Technische Universität München, Munich, Germany

  • Venue:
  • ICME'09 Proceedings of the 2009 IEEE international conference on Multimedia and Expo
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper, the development of a framework based on the Real-time Database (RTDB) for processing multimodal data is presented. This framework allows readily integration of input and output modules. Furthermore the asynchronous data streams from different sources can be approximately processed in a synchronous manner. Depending on the included modules, online as well as offline data processing is possible. The idea is to establish a real multimodal interaction system that is able to recognize and react to those situations that are relevant for human-robot interaction.