Automatic video annotation and retrieval based on bayesian inference

  • Authors:
  • Fangshi Wang;De Xu;Wei Lu;Weixin Wu

  • Affiliations:
  • School of Computer &Information Technology, Beijing Jiaotong University;School of Computer &Information Technology, Beijing Jiaotong University;School of Software, Beijing Jiaotong University, Beijing, China;School of Computer &Information Technology, Beijing Jiaotong University

  • Venue:
  • MMM'07 Proceedings of the 13th international conference on Multimedia Modeling - Volume Part I
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

Retrieving videos by key words requires semantic knowledge of the videos. However, manual video annotation is very costly and time consuming. Most works reported in literatures focus on annotating a video shot with either only one semantic concept or a fixed number of words. In this paper, we propose a new approach to automatically annotate a video shot with a non-fixed number of semantic concepts and to retrieve videos based on text queries. First, a simple but efficient method is presented to automatically extract Semantic Candidate Set (SCS) for a video shot based on visual features. Then, the final annotation set is obtained from SCS by Bayesian Inference. Finally, a new way is proposed to rank the retrieved key frames according to the probabilities obtained during Bayesian Inference. Experiments show that our method is useful in automatically annotating video shots and retrieving videos by key words.