Integrating Graph-Based Vision Perception to Spoken Conversation in Human-Robot Interaction

Authors:
Wendy Aguilar;Luis A. Pineda
Affiliations:
Departamento de Ciencias de la Computación, Instituto de Investigaciones en Matemáticas Aplicadas y en Sistemas, Universidad Nacional Autónoma de México, México 01000;Departamento de Ciencias de la Computación, Instituto de Investigaciones en Matemáticas Aplicadas y en Sistemas, Universidad Nacional Autónoma de México, México 01000
Venue:
IWANN '09 Proceedings of the 10th International Work-Conference on Artificial Neural Networks: Part I: Bio-Inspired Systems: Computational and Ambient Intelligence
Year:
2009

Citing 7
Cited 1

Using Speech in Visual Object Recognition

Mustererkennung 2000, 22. DAGM-Symposium
Shape Indexing Using Approximate Nearest-Neighbour Search in High-Dimensional Spaces

CVPR '97 Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97)
An architecture for a generic dialogue shell

Natural Language Engineering
Distinctive Image Features from Scale-Invariant Keypoints

International Journal of Computer Vision
A Performance Evaluation of Local Descriptors

IEEE Transactions on Pattern Analysis and Machine Intelligence
Towards adaptive object recognition for situated human-computer interaction

Proceedings of the 2007 workshop on Multimodal interfaces in semantic interaction
A robust Graph Transformation Matching for non-rigid registration

Image and Vision Computing

Dialogue model specification and interpretation for intelligent multimodal HCI

IBERAMIA'10 Proceedings of the 12th Ibero-American conference on Advances in artificial intelligence

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper we present the integration of graph-based visual perception to spoken conversation in human-robot interaction. The proposed architecture has a dialogue manager as the central component for the multimodal interaction, which directs the robot's behavior in terms of the intentions and actions associated to the conversational situations. We tested this ideas on a mobile robot programmed to act as a visitor's guide to our department of computer science.