Web Image Retrieval for Abstract Queries Using Text and Image Information

  • Authors:
  • Kazutaka Shimada;Suguru Ishikawa;Tsutomu Endo

  • Affiliations:
  • Department of Artificial Intelligence, Kyushu Institute of Technology, Fukuoka, Japan 820-8502;Department of Artificial Intelligence, Kyushu Institute of Technology, Fukuoka, Japan 820-8502;Department of Artificial Intelligence, Kyushu Institute of Technology, Fukuoka, Japan 820-8502

  • Venue:
  • AIRS '09 Proceedings of the 5th Asia Information Retrieval Symposium on Information Retrieval Technology
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper, we propose a method for image retrieval on the web. In this task, we focus on abstract words that do not directly link to images that we want. For example, a user might use a query "summer" to retrieve images of "fireworks" or "a white sand beach with the sea". In this case retrieval systems need to infer direct words for the images from the abstract query of the user. In our method, we extract related words about a query from the web first. Second, we retrieve images from the web by using the extracted words. Then, a user selects relevant images from the retrieved images. Next, the system computes a similarity between selected images and other images and ranks the images on the basis of the similarity. We use the Earth Mover's Distance as the similarity. The experimental result shows the effectiveness of our method that uses text and image information for the image retrieval process.