Multimodal re-ranking of product image search results

  • Authors:

  • Joyce M. dos Santos;João M. B. Cavalcanti;Patricia C. Saraiva;Edleno S. de Moura

  • Affiliations:

  • Institute of Computing, Federal Unversity of Amazonas, Manaus, Brazil;Institute of Computing, Federal Unversity of Amazonas, Manaus, Brazil;Institute of Computing, Federal Unversity of Amazonas, Manaus, Brazil;Institute of Computing, Federal Unversity of Amazonas, Manaus, Brazil

  • Venue:
  • ECIR'13 Proceedings of the 35th European conference on Advances in Information Retrieval
  • Year:
  • 2013

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this article we address the problem of searching for products using an image as query, instead of the more popular approach of searching by textual keywords. With the fast development of the Internet, the popularization of mobile devices and e-commerce systems, searching specific products by image has become an interesting research topic. In this context, Content-Based Image Retrieval (CBIR) techniques have been used to support and enhance the customer shopping experience. We propose an image re-ranking strategy based on multimedia information available on product databases. Our re-ranking strategy relies on category and textual information associated to the top-k images of an initial ranking computed purely with CBIR techniques. Experiments were carried out with users' relevance judgment on two image datasets collected from e-commerce Web sites. Our results show that our re-ranking strategy outperforms the baselines when using only CBIR techniques.