A dialogue approach to learning object descriptions and semantic categories
Robotics and Autonomous Systems
A communication robot in a shopping mall
IEEE Transactions on Robotics
Robotic orientation towards speaker for human-robot interaction
IBERAMIA'10 Proceedings of the 12th Ibero-American conference on Advances in artificial intelligence
Development of a tour-guide robot using dialogue models and a cognitive architecture
IBERAMIA'10 Proceedings of the 12th Ibero-American conference on Advances in artificial intelligence
A multimodal human-robot-dialog applying emotional feedbacks
ICSR'10 Proceedings of the Second international conference on Social robotics
Spatially-aware dialogue control using hierarchical reinforcement learning
ACM Transactions on Speech and Language Processing (TSLP)
Feature fusion for 3D hand gesture recognition by learning a shared hidden space
Pattern Recognition Letters
HRI '12 Proceedings of the seventh annual ACM/IEEE international conference on Human-Robot Interaction
Knowledge acquisition through human---robot multimodal interaction
Intelligent Service Robotics
A dialogue system for multimodal human-robot interaction
Proceedings of the 15th ACM on International conference on multimodal interaction
Myoelectric control techniques for a rehabilitation robot
Applied Bionics and Biomechanics - Assistive and Rehabilitation Robotics
| Hi-index | 0.00 |
In this paper, we present our work in building technologies for natural multimodal human-robot interaction. We present our systems for spontaneous speech recognition, multimodal dialogue processing, and visual perception of a user, which includes localization, tracking, and identification of the user, recognition of pointing gestures, as well as the recognition of a person's head orientation. Each of the components is described in the paper and experimental results are presented. We also present several experiments on multimodal human-robot interaction, such as interaction using speech and gestures, the automatic determination of the addressee during human-human-robot interaction, as well on interactive learning of dialogue strategies. The work and the components presented here constitute the core building blocks for audiovisual perception of humans and multimodal human-robot interaction used for the humanoid robot developed within the German research project (Sonderforschungsbereich) on humanoid cooperative robots.