Multimodal human-machine interaction for service robots in home-care environments

  • Authors:
  • Stefan Goetze;Sven Fischer;Niko Moritz;Jens-E. Appell;Frank Wallhoff

  • Affiliations:
  • Fraunhofer Institute for Digital Media Technology (IDMT), Oldenburg, Germany;Fraunhofer Institute for Digital Media Technology (IDMT), Oldenburg, Germany;Fraunhofer Institute for Digital Media Technology (IDMT), Oldenburg, Germany;Fraunhofer Institute for Digital Media Technology (IDMT), Oldenburg, Germany;Fraunhofer Institute for Digital Media Technology (IDMT), Oldenburg, Germany and Jade University of Applied Sciences, Oldenburg, Germany

  • Venue:
  • SMIAE '12 Proceedings of the 1st Workshop on Speech and Multimodal Interaction in Assistive Environments
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

This contribution focuses on multimodal interaction techniques for a mobile communication and assistance system on a robot platform. The system comprises of acoustic, visual and haptic input modalities. Feedback is given to the user by a graphical user interface and a speech synthesis system. By this, multimodal and natural communication with the robot system is possible.