Using depth features to retrieve monocular video shots

  • Authors:
  • Ralph Ewerth;Martin Schwalb;Bernd Freisleben

  • Affiliations:
  • University of Marburg, Marburg, Germany;University of Marburg, Marburg, Germany;University of Marburg, Marburg, Germany

  • Venue:
  • Proceedings of the 6th ACM international conference on Image and video retrieval
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

In recent years, many features have been suggested to facilitate the task of video retrieval. However, up to now, three-dimensional (3D) scene information has not been utilized to retrieve shots from a database consisting of monocular video sequences. In this paper, we propose the use of depth features for video retrieval purposes. Our depth feature extraction approach is based on a method that originally has been suggested to scan 3D objects with a single camera exploiting the motion parallax. To increase the number of video shots for which the depth feature extraction method is applicable, we present an extension of the self-calibration algorithm of this method. Furthermore, a depth map representation is presented and an adequate distance measure is suggested to compare depth maps. Finally, the extracted depth features are used to retrieve video shots according to the three-dimensional scene content of a shot. Experimental results for the comprehensive TRECVID 2005 video data set demonstrate the usefulness of the proposed depth features for video retrieval.