Recognition of gestural object reference with auditory feedback

Authors:
Ingo Bax;Holger Bekel;Gunther Heidemann
Affiliations:
Faculty of Technology, Bielefeld University, Bielefeld, Germany;Faculty of Technology, Bielefeld University, Bielefeld, Germany;Faculty of Technology, Bielefeld University, Bielefeld, Germany
Venue:
ICANN/ICONIP'03 Proceedings of the 2003 joint international conference on Artificial neural networks and neural information processing
Year:
2003

Citing 11
Cited 0

Self-organization and associative memory: 3rd edition

Self-organization and associative memory: 3rd edition
Context-free attentional operators: the generalized symmetry transform

International Journal of Computer Vision - Special issue on qualitative vision
A Model of Saliency-Based Visual Attention for Rapid Scene Analysis

IEEE Transactions on Pattern Analysis and Machine Intelligence
Mixtures of probabilistic principal component analyzers

Neural Computation
Evaluation of Interest Point Detectors

International Journal of Computer Vision - Special issue on a special section on visual surveillance
Efficient Vector Quantization Using the WTA-Rule with Activity Equalization

Neural Processing Letters
Data- and Model-Driven Gaze Control for an Active-Vision System

IEEE Transactions on Pattern Analysis and Machine Intelligence
Attentional Selection for Object Recognition A Gentle Way

BMCV '02 Proceedings of the Second International Workshop on Biologically Motivated Computer Vision
Entropie als Maß des lokalen Informationsgehalts in Bildern zur Realisierung einer Aufmerksamkeitssteuerung

Mustererkennung 1996, 18. DAGM-Symposium
A System for Various Visual Classification Tasks Based on Neural Networks

ICPR '00 Proceedings of the International Conference on Pattern Recognition - Volume 1
Integrating context-free and context-dependent attentional mechanisms for gestural object reference

ICVS'03 Proceedings of the 3rd international conference on Computer vision systems

Quantified Score

Hi-index	0.00

Visualization

Abstract

We present a cognitively motivated vision architecture for the evaluation of pointing gestures. The system views a scene of several structured objects and a pointing human hand. A neural classifier gives an estimation of the pointing direction, then the object correspondence is established using a sub-symbolic representation of both the scene and the pointing direction. The system achieves high robustness because the result (the indicated location) does not primarily depend on the accuracy of the pointing direction classification. Instead, the scene is analysed for low level saliency features to restrict the set of all possible pointing locations to a subset of highly likely locations. This transformation of the "continuous" to a "discrete" pointing problem simultaneously facilitates an auditory feedback whenever the object reference changes, which leads to a significantly improved human-machine interaction.