Video clip retrieval by maximal matching and optimal matching in graph theory

  • Authors:
  • Yu-Xin Peng;Chong-Wah Ngo;Qing-Jie Dong;Zong-Ming Guo;Jian-Guo Xiao

  • Affiliations:
  • Inst. of Comput. Sci. & Technol., Peking Univ., Beijing, China;Sch. of Comput. Sci., Carnegie Mellon Univ., Pittsburgh, PA, USA;Sch. of Comput. Sci., Carnegie Mellon Univ., Pittsburgh, PA, USA;Comput. Sci. & Inf. Eng., Nat. Taiwan Univ., Taipei, Taiwan;Dept. of Electr. Eng., Nat. Taiwan Univ., Taipei, Taiwan

  • Venue:
  • ICME '03 Proceedings of the 2003 International Conference on Multimedia and Expo - Volume 2
  • Year:
  • 2003

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper, a novel approach for automatic matching, ranking and retrieval of video clips is proposed. Motivated by the maximal and optimal matching theories in graph analysis, a new similarity measure of video clips is defined based on the representation and modeling of bipartite graph. Four different factors: visual similarity, granularity, interference and temporal order of shots are taken into consideration for similarity ranking. These factors are progressively analyzed in the proposed approach. Maximal matching utilizes the granularity factor to efficiently filter false matches, while optimal matching takes into account the visual, granularity and interference factors for similarity measure. Dynamic programming is also formulated to quantitatively evaluate the temporal order of shots. The final similarity measure is based on the results of optimal matching and dynamic programming. Experimental results indicate that the proposed approach is effective and efficient in retrieving and ranking similar video clips.