Human-style interaction with a robot for cooperative learning of scene objects

Authors:
Shuyin Li;Axel Haasch;Britta Wrede;Jannik Fritsch;Gerhard Sagerer
Affiliations:
Bielefeld University, Bielefeld, Germany;Bielefeld University, Bielefeld, Germany;Bielefeld University, Bielefeld, Germany;Bielefeld University, Bielefeld, Germany;Bielefeld University, Bielefeld, Germany
Venue:
ICMI '05 Proceedings of the 7th international conference on Multimodal interfaces
Year:
2005

Citing 3
Cited 4

A computational theory of grounding in natural language conversation

A computational theory of grounding in natural language conversation
A Model of Saliency-Based Visual Attention for Rapid Scene Analysis

IEEE Transactions on Pattern Analysis and Machine Intelligence
Multi-Modal Interaction of Human and Home Robot in the Context of Room Map Generation

Autonomous Robots

Spontaneous speech understanding for robust multi-modal human-robot communication

COLING-ACL '06 Proceedings of the COLING/ACL on Main conference poster sessions
A computational model of multi-modal grounding for human robot interaction

SigDIAL '06 Proceedings of the 7th SIGdial Workshop on Discourse and Dialogue
A computational model for the alignment of hierarchical scene representations in human-robot interaction

IJCAI'09 Proceedings of the 21st international jont conference on Artifical intelligence
Knowledge acquisition through human---robot multimodal interaction

Intelligent Service Robotics

Quantified Score

Hi-index	0.00

Visualization

Abstract

In research on human-robot interaction the interest is currently shifting from uni-modal dialog systems to multi-modal interaction schemes. We present a system for human-style interaction with a robot that is integrated on our mobile robot BIRON. To model the dialog we adopt an extended grounding concept with a mechanism to handle multi-modal in- and output where object references are resolved by the interaction with an object attention system (OAS). The OAS integrates multiple input from, e.g., the object and gesture recognition systems and provides the information for a common representation. This representation can be accessed by both modules and combines symbolic verbal attributes with sensor-based features. We argue that such a representation is necessary to achieve a robust and efficient information processing.