Segregated feedback with performance-based adaptive sampling for interactive news video retrieval

  • Authors:
  • Huan-Bo Luan;Shi-Yong Neo;Hai-Kiat Goh;Yong-Dong Zhang;Shou-Xun Lin;Tat-Seng Chua

  • Affiliations:
  • Chinese Academy of Sciences, Beijing, China & CAS, Beijing, China;National University of Singapore, Singapore, Singapore;National University of Singapore, Singapore, Singapore;Chinese Academy of Sciences, Beijing, China & CAS, Beijing, China;Chinese Academy of Sciences, Beijing, China & CAS, Beijing, China;National University of Singapore, Singapore, Singapore

  • Venue:
  • Proceedings of the 15th international conference on Multimedia
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

Existing video research incorporates the use of relevance feedback based on user-dependent interpretations to improve the retrieval results. In this paper, we segregate the process of relevance feedback into 2 distinct facets: (a) recall-directed feedback; and (b) precision-directed feedback. The recall-directed facet employs general features such as text and high level features (HLFs) to maximize efficiency and recall during feedback, making it very suitable for large corpuses. The precision-directed facet on the other hand uses many other multimodal features in an active learning environment for improved accuracy. Combined with a performance-based adaptive sampling strategy, this process continuously re-ranks a subset of instances as the user annotates. Experiments done using TRECVID 2006 dataset show that our approach is efficient and effective.