Activity recognition in wide aerial video surveillance using entity relationship models

  • Authors:
  • Jongmoo Choi;Yann Dumortier;Jan Prokaj;Gérard Medioni

  • Affiliations:
  • University of Southern California;University of Southern California;University of Southern California;University of Southern California

  • Venue:
  • Proceedings of the 20th International Conference on Advances in Geographic Information Systems
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

We present the design and implementation of an activity recognition system in wide area aerial video surveillance using Entity Relationship Models (ERM). In this approach, finding an activity is equivalent to sending a query to a Relational DataBase Management System (RDBMS). By incorporating reference imagery and Geographic Information System (GIS) data, tracked objects can be associated with physical meanings, and several high levels of reasoning, such as traffic patterns or abnormal activity detection, can be performed. We demonstrate that different types of activities, with hierarchical structure, multiple actors, and context information, are effectively and efficiently defined and inferred using the ERM framework. We also show how visual tracks can be better interpreted as activities by using geo information. Experimental results on both real visual tracks and GPS traces validate our approach.