A dialogue approach to learning object descriptions and semantic categories

Authors:
Hartwig Holzapfel;Daniel Neubig;Alex Waibel
Affiliations:
interAct Research, Interactive Systems Lab, Universität Karlsruhe, Germany;interAct Research, Interactive Systems Lab, Universität Karlsruhe, Germany;interAct Research, Interactive Systems Lab, Universität Karlsruhe, Germany
Venue:
Robotics and Autonomous Systems
Year:
2008

Citing 12
Cited 5

The logic of typed feature structures

The logic of typed feature structures
A Multimodal System for Object Learning

Proceedings of the 24th DAGM Symposium on Pattern Recognition
Adaptive Dialog Based upon Multimodal Language Acquisition

ICMI '02 Proceedings of the 4th IEEE International Conference on Multimodal Interfaces
Object Recognition from Local Scale-Invariant Features

ICCV '99 Proceedings of the International Conference on Computer Vision-Volume 2 - Volume 2
Towards a self-extending parser

ACL '79 Proceedings of the 17th annual meeting on Association for Computational Linguistics
Probabilistic grounding of situated speech using plan recognition and reference resolution

ICMI '05 Proceedings of the 7th international conference on Multimodal interfaces
Using redundant speech and handwriting for learning new vocabulary and understanding abbreviations

Proceedings of the 8th international conference on Multimodal interfaces
Automatic object model acquisition and object recognition by integrating linguistic and visual information

Proceedings of the 15th international conference on Multimedia
Developing and analyzing intuitive modes for interactive object modeling

Proceedings of the 9th international conference on Multimodal interfaces
A robot learns to know people: first contacts of a robot

KI'06 Proceedings of the 29th annual German conference on Artificial intelligence
Online learning for object recognition with a hierarchical visual cortex model

ICANN'05 Proceedings of the 15th international conference on Artificial Neural Networks: biological Inspirations - Volume Part I
Enabling Multimodal Human–Robot Interaction for the Karlsruhe Humanoid Robot

IEEE Transactions on Robotics

Grounding commonsense knowledge in intelligent systems

Journal of Ambient Intelligence and Smart Environments
Learning Novel Objects for Extended Mobile Manipulation

Journal of Intelligent and Robotic Systems
Grounding commonsense knowledge in intelligent systems

Journal of Ambient Intelligence and Smart Environments
Correcting phoneme recognition errors in learning word pronunciation through speech interaction

Speech Communication
Disambiguation in unknown object detection by integrating image and speech recognition confidences

ACCV'12 Proceedings of the 11th Asian conference on Computer Vision - Volume Part I

Quantified Score

Hi-index	0.00

Visualization

Abstract

Acquiring new knowledge through interactive learning mechanisms is a key ability for humanoid robots in a natural environment. Such learning mechanisms need to be performed autonomously, and through interaction with the environment or with other agents/humans. In this paper, we describe a dialogue approach and a dynamic object model for learning semantic categories, object descriptions, and new words acquisition for object learning and integration with visual perception for grounding objects in the real world. The presented system has been implemented and evaluated on the humanoid robot Armar III.