2005 Special Issue: Interactive image data labeling using self-organizing maps in an augmented reality scenario

Authors:
Holger Bekel;Gunther Heidemann;Helge Ritter
Affiliations:
Neuroinformatics Group, Bielefeld University, P.O. Box 10 01 31, D-33501 Bielefeld, Germany;Neuroinformatics Group, Bielefeld University, P.O. Box 10 01 31, D-33501 Bielefeld, Germany;Neuroinformatics Group, Bielefeld University, P.O. Box 10 01 31, D-33501 Bielefeld, Germany
Venue:
Neural Networks - 2005 Special issue: IJCNN 2005
Year:
2005

Citing 10
Cited 4

Topology representing networks

Neural Networks
Visual learning and recognition of 3-D objects from appearance

International Journal of Computer Vision
SEEMORE: combining color, shape, and texture histogramming in a neurally inspired approach to visual object recognition

Neural Computation
Self-Organizing Maps and Learning Vector Quantization forFeature Sequences

Neural Processing Letters
Efficient use of local edge histogram descriptor

MULTIMEDIA '00 Proceedings of the 2000 ACM workshops on Multimedia
Focus-of-Attention from Local Color Symmetries

IEEE Transactions on Pattern Analysis and Machine Intelligence
Multimodal interaction in an augmented reality scenario

Proceedings of the 6th international conference on Multimodal interfaces
The MPEG-7 visual standard for content description-an overview

IEEE Transactions on Circuits and Systems for Video Technology
Color and texture descriptors

IEEE Transactions on Circuits and Systems for Video Technology
PicSOM-self-organizing image retrieval with MPEG-7 content descriptors

IEEE Transactions on Neural Networks

A multimodal labeling interface for wearable computing

Proceedings of the 15th international conference on Intelligent user interfaces
A discussion on visual interactive data exploration using self-organizing maps

WSOM'11 Proceedings of the 8th international conference on Advances in self-organizing maps
Efficient annotation of image data sets for computer vision applications

Proceedings of the 1st International Workshop on Visual Interfaces for Ground Truth Collection in Computer Vision Applications
Application of neural networks in detection of abnormal brain perfusion regions

Neurocomputing

Quantified Score

Hi-index	0.00

Visualization

Abstract

We present an approach for the convenient labeling of image patches gathered from an unrestricted environment. The system is employed for a mobile Augmented Reality (AR) gear: while the user walks around with the head-mounted AR-gear, context-free modules for focus-of-attention permanently sample the most 'interesting' image patches. After this acquisition phase, a Self-Organizing Map (SOM) is trained on the complete set of patches, using combinations of MPEG-7 features as a data representation. The SOM allows visualization of the sampled patches and an easy manual sorting into categories. With very little effort, the user can compose a training set for a classifier, thus, unknown objects can be made known to the system. We evaluate the system for COIL-imagery and demonstrate that a user can reach satisfying categorization within few steps, even for image data sampled from walking in an office environment. (An abbreviated version of some portions of this article appeared in [Bekel, H., Heidemann, G., & Ritter, H. (2005). SOM Based Image Data Structuring in an Augmented Reality Scenario. In Proceedings of the International Joint Conference on Neural Networks, Montreal, Canada.], as part of the IJCNN 2005 conference proceedings, published under the IEEE copyright).