A multimodal human-robot-dialog applying emotional feedbacks

Authors:
Alexander Bannat;Jürgen Blume;Jürgen T. Geiger;Tobias Rehrl;Frank Wallhoff;Christoph Mayer;Bernd Radig;Stefan Sosnowski;Kolja Kühnlenz
Affiliations:
Human-Machine Communication, Department of Electrical Engineering and Information Technologies, Technische Universität München, Munich, Germany;Human-Machine Communication, Department of Electrical Engineering and Information Technologies, Technische Universität München, Munich, Germany;Human-Machine Communication, Department of Electrical Engineering and Information Technologies, Technische Universität München, Munich, Germany;Human-Machine Communication, Department of Electrical Engineering and Information Technologies, Technische Universität München, Munich, Germany;Human-Machine Communication, Department of Electrical Engineering and Information Technologies, Technische Universität München, Munich, Germany and Jade University of Applied Sciences, O ...;Image Understanding and Knowledge-Based Systems, Department of Informatics, Technische Universität München, Munich, Germany;Image Understanding and Knowledge-Based Systems, Department of Informatics, Technische Universität München, Munich, Germany;Institute of Automatic Control Engineering, Department of Electrical Engineering and Information Technologies, Technische Universität München, Munich, Germany;Institute of Automatic Control Engineering, Department of Electrical Engineering and Information Technologies, Technische Universität München, Munich, Germany
Venue:
ICSR'10 Proceedings of the Second international conference on Social robotics
Year:
2010

Citing 9
Cited 1

Automatic Analysis of Facial Expressions: The State of the Art

IEEE Transactions on Pattern Analysis and Machine Intelligence
Active Appearance Models

ECCV '98 Proceedings of the 5th European Conference on Computer Vision-Volume II - Volume II
Multimodal interfaces

The human-computer interaction handbook
Advanced training methods and new network topologies for hybrid MMI-Connectionist/HMM speech recognition systems

ICASSP '97 Proceedings of the 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP '97) -Volume 4 - Volume 4
Robust Real-Time Face Detection

International Journal of Computer Vision
A Comparison Between Continuous and Discrete Density Hidden Markov Models for Cursive Handwriting Recognition

ICPR '96 Proceedings of the 13th International Conference on Pattern Recognition - Volume 2
Using vision, acoustics, and natural language for disambiguation

Proceedings of the ACM/IEEE international conference on Human-robot interaction
Did I Get It Right: Head Gestures Analysis for Human-Machine Interactions

Proceedings of the 13th International Conference on Human-Computer Interaction. Part II: Novel Interaction Methods and Techniques
Enabling Multimodal Human–Robot Interaction for the Karlsruhe Humanoid Robot

IEEE Transactions on Robotics

Knowledgeable talking robots

AGI'13 Proceedings of the 6th international conference on Artificial General Intelligence

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper presents a system for human-robot communication situated in an ambient assisted living scenario, where the robot performs an order-and-serve-procedure. The interaction is based on different modalities that extract information from the auditory and the visual channel in order to obtain an intuitive and natural dialog. The required interaction dialog structure is represented in first-order logic, which allows to split a complex task into simpler subtasks. The different communication modalities are utilized to conclude these subtasks by determining information about the human interaction partner. The system works in real-time and robust and utilizes emotional feedback to enrich the communication process.