A linear-algebraic technique with an application in semantic image retrieval

Authors:
Jonathon S. Hare;Paul H. Lewis;Peter G. B. Enser;Christine J. Sandom
Affiliations:
School of Electronics and Computer Science, University of Southampton, UK;School of Electronics and Computer Science, University of Southampton, UK;School of Computing, Mathematical and Information Sciences, University of Brighton, UK;School of Computing, Mathematical and Information Sciences, University of Brighton, UK
Venue:
CIVR'06 Proceedings of the 5th international conference on Image and Video Retrieval
Year:
2006

Citing 6
Cited 10

Shape and motion from image streams under orthography: a factorization method

International Journal of Computer Vision
Object Recognition as Machine Translation: Learning a Lexicon for a Fixed Image Vocabulary

ECCV '02 Proceedings of the 7th European Conference on Computer Vision-Part IV
On image auto-annotation with latent space models

MULTIMEDIA '03 Proceedings of the eleventh ACM international conference on Multimedia
Surveying the reality of semantic image retrieval

VISUAL'05 Proceedings of the 8th international conference on Visual Information and Information Systems
Automated image annotation using global features and robust nonparametric density estimation

CIVR'05 Proceedings of the 4th international conference on Image and Video Retrieval
On image retrieval using salient regions with vector-spaces and latent semantics

CIVR'05 Proceedings of the 4th international conference on Image and Video Retrieval

Semantic facets: an in-depth analysis of a semantic image retrieval system

Proceedings of the 6th ACM international conference on Image and video retrieval
Non-negative matrix factorisation for object class discovery and image auto-annotation

CIVR '08 Proceedings of the 2008 international conference on Content-based image and video retrieval
Semantic spaces revisited: investigating the performance of auto-annotation and semantic retrieval using semantic spaces

CIVR '08 Proceedings of the 2008 international conference on Content-based image and video retrieval
A discrete direct retrieval model for image and video retrieval

CIVR '08 Proceedings of the 2008 international conference on Content-based image and video retrieval
Performing Content-Based Retrieval of Humans Using Gait Biometrics

SAMT '08 Proceedings of the 3rd International Conference on Semantic and Digital Media Technologies: Semantic Multimedia
Automatically annotating the MIR Flickr dataset: experimental protocols, openly available data and semantic spaces

Proceedings of the international conference on Multimedia information retrieval
NMF-based multimodal image indexing for querying by visual example

Proceedings of the ACM International Conference on Image and Video Retrieval
Performing content-based retrieval of humans using gait biometrics

Multimedia Tools and Applications
Multimodal representation, indexing, automated annotation and retrieval of image collections via non-negative matrix factorization

Neurocomputing
Automatic annotation of tagged content using predefined semantic concepts

Proceedings of the 18th Brazilian symposium on Multimedia and the web

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper presents a novel technique for learning the underlying structure that links visual observations with semantics. The technique, inspired by a text-retrieval technique known as cross-language latent semantic indexing uses linear algebra to learn the semantic structure linking image features and keywords from a training set of annotated images. This structure can then be applied to unannotated images, thus providing the ability to search the unannotated images based on keyword. This factorisation approach is shown to perform well, even when using only simple global image features.