NMF-based multimodal image indexing for querying by visual example

  • Authors:
  • Fabio A. González;Juan C. Caicedo;Olfa Nasraoui;Jaafar Ben-Abdallah

  • Affiliations:
  • Universidad Nacional de Colombia;Universidad Nacional de Colombia;University of Louisville;University of Louisville

  • Venue:
  • Proceedings of the ACM International Conference on Image and Video Retrieval
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper proposes a method for image indexing that allows to retrieve related images under the query-by-example paradigm. The proposed strategy exploits multimodal interactions between text annotations and visual contents in the image database to build a semantic index. We achieve this using a Non-negative Matrix Factorization algorithm to construct a latent semantic space in which visual features and text terms are represented together. The proposed system was evaluated using a standard benchmark dataset. The experimental evaluation shows a significant improvement on the system performance using the proposed multimodal indexing approach.