A computer vision integration model for a multi-modal cognitive system

Authors:
Alen Vrečko;Danijel Skočaj;Nick Hawes;Aleš Leonardis
Affiliations:
Faculty of Computer and Information Science, University of Ljubljana, Slovenia;Faculty of Computer and Information Science, University of Ljubljana, Slovenia;School of Computer Science, University of Birmingham, UK;Faculty of Computer and Information Science, University of Ljubljana, Slovenia
Venue:
IROS'09 Proceedings of the 2009 IEEE/RSJ international conference on Intelligent robots and systems
Year:
2009

Citing 7
Cited 2

The symbol grounding problem

CNLS '89 Proceedings of the ninth annual international conference of the Center for Nonlinear Studies on Self-organizing, Collective, and Cooperative Phenomena in Natural and Artificial Computing Networks on Emergent computation
A cognitive architecture for artificial vision

Artificial Intelligence
The Hearsay-II Speech-Understanding System: Integrating Knowledge to Resolve Uncertainty

ACM Computing Surveys (CSUR)
Crossmodal content binding in information-processing architectures

Proceedings of the 3rd ACM/IEEE international conference on Human robot interaction
Towards an integrated robot with multiple cognitive functions

AAAI'07 Proceedings of the 22nd national conference on Artificial intelligence - Volume 2
Mediating between qualitative and quantitative representations for task-orientated human-robot interaction

IJCAI'07 Proceedings of the 20th international joint conference on Artifical intelligence
Cognitive Systems: Cognitive Systems Monographs

Cognitive Systems: Cognitive Systems Monographs

Binding and cross-modal learning in markov logic networks

ICANNGA'11 Proceedings of the 10th international conference on Adaptive and natural computing algorithms - Volume Part II
Modeling binding and cross-modal learning in Markov logic networks

Neurocomputing

Quantified Score

Hi-index	0.00

Visualization

Abstract

We present a general method for integrating visual components into a multi-modal cognitive system. The integration is very generic and can work with an arbitrary set of modalities. We illustrate our integration approach with a specific instantiation of the architecture schema that focuses on integration of vision and language: a cognitive system able to collaborate with a human, learn and display some understanding of its surroundings. As examples of cross-modal interaction we describe mechanisms for clarification and visual learning.