The effects of heterogeneous information combination on large scale social image search

  • Authors:
  • Zhiyong Cheng;Jing Ren;Jialie Shen;Haiyan Miao

  • Affiliations:
  • Singapore Management University, Singapore;Singapore Management University, Singapore;Singapore Management University, Singapore;Institute of High Performance Computing A *STAR, Singapore

  • Venue:
  • Proceedings of the Third International Conference on Internet Multimedia Computing and Service
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper documents a comprehensive empirical study of the effects of heterogeneous information combination on large scale social image search. Our goal is to investigate how various kinds of information source can contribute the improvement of the retrieval effectiveness. In particular, a linear combination has been applied to merge search results from search module based on textual and visual features. Also, we propose different weighting schemes to integrate different kinds of query evidences in a nonlinear way. A series of experiments have been conducted using two large scale social image collections. Empirical results suggest that the system based on textual features yields much more effective and reliable results comparing to one using visual information. Further, the combination of two information sources can consistently enhance the final accuracy.