A query language combining object features and semantic events for surveillance video retrieval

  • Authors:
  • Thi-Lan Le;Monique Thonnat;Alain Boucher;François Brémond

  • Affiliations:
  • ORION, INRIA, Sophia Antipolis, France and International Research Center MICA Hanoi University of Technology, Viet Nam;ORION, INRIA, Sophia Antipolis, France;Equipe MSI, Institut de la Francophonie pour l'Informatique, Hanoi, Viet Nam;ORION, INRIA, Sophia Antipolis, France

  • Venue:
  • MMM'08 Proceedings of the 14th international conference on Advances in multimedia modeling
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper, we propose a novel query language for video indexing and retrieval that (1) enables to make queries both at the image level and at the semantic level (2) enables the users to define their own scenarios based on semantic events and (3) retrieves videos with both exact matching and similarity matching. For a query language, four main issues must be addressed: data modeling, query formulation, query parsing and query matching. In this paper we focus and give contributions on data modeling, query formulation and query matching. We are currently using color histograms and SIFT features at the image level and 10 types of events at the semantic level. We have tested the proposed query language for the retrieval of surveillance videos of a metro station. In our experiments the database contains more than 200 indexed physical objects and 48 semantic events. The results using different types of queries are promising.