Integrating language, vision and action for human robot dialog systems

Authors:
Markus Rickert;Mary Ellen Foster;Manuel Giuliani;Tomas By;Giorgio Panin;Alois Knoll
Affiliations:
Department of Informatics, Technische Universität München, München, Germany;Department of Informatics, Technische Universität München, München, Germany;Department of Informatics, Technische Universität München, München, Germany;Department of Informatics, Technische Universität München, München, Germany;Department of Informatics, Technische Universität München, München, Germany;Department of Informatics, Technische Universität München, München, Germany
Venue:
UAHCI'07 Proceedings of the 4th international conference on Universal access in human-computer interaction: ambient interaction
Year:
2007

Citing 8
Cited 8

Synthesizing realistic facial expressions from photographs

Proceedings of the 25th annual conference on Computer graphics and interactive techniques
The syntactic process

The syntactic process
A New Approach to Object-Oriented Middleware

IEEE Internet Computing
iCat: an animated user-interface robot with personality

Proceedings of the fourth international joint conference on Autonomous agents and multiagent systems
An Efficient and Robust Real-Time Contour Tracking System

ICVS '06 Proceedings of the Fourth IEEE International Conference on Computer Vision Systems
The human-robot interaction operating system

Proceedings of the 1st ACM SIGCHI/SIGART conference on Human-robot interaction
Human-Robot dialogue for joint construction tasks

Proceedings of the 8th international conference on Multimodal interfaces
Explorations in engagement for humans and robots

Artificial Intelligence

The roles of haptic-ostensive referring expressions in cooperative, task-based human-robot dialogue

Proceedings of the 3rd ACM/IEEE international conference on Human robot interaction
MultiML: a general purpose representation language for multimodal human utterances

ICMI '08 Proceedings of the 10th international conference on Multimodal interfaces
Attention driven visual processing for an interactive dialog robot

Proceedings of the 2009 ACM symposium on Applied Computing
Evaluating description and reference strategies in a cooperative human-robot dialogue system

IJCAI'09 Proceedings of the 21st international jont conference on Artifical intelligence
Comparing objective and subjective measures of usability in a human-robot dialogue system

ACL '09 Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP: Volume 2 - Volume 2
Constraint task-based control in industrial settings

IROS'09 Proceedings of the 2009 IEEE/RSJ international conference on Intelligent robots and systems
Intelligent humanoid robot with japanese Wikipedia ontology and robot action ontology

Proceedings of the 6th international conference on Human-robot interaction
Estimating a user’s internal state before the first input utterance

Advances in Human-Computer Interaction

Quantified Score

Hi-index	0.00

Visualization

Abstract

Developing a robot system that can interact directly with a human instructor in a natural way requires not only highly-skilled sensorimotor coordination and action planning on the part of the robot, but also the ability to understand and communicate with a human being in many modalities. A typical application of such a system is interactive assembly for construction tasks. A human communicator sharing a common view of the work area with the robot system instructs the latter by speaking to it in the same way that he would communicate with a human partner.