Video Activity Extraction and Reporting with Incremental Unsupervised Learning

  • Authors:
  • Luis Patino;Francois Bremond;Murray Evans;Ali Shahrokni;James Ferryman

  • Affiliations:
  • -;-;-;-;-

  • Venue:
  • AVSS '10 Proceedings of the 2010 7th IEEE International Conference on Advanced Video and Signal Based Surveillance
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

The present work presents a new method for activity extractionand reporting from video based on the aggregationof fuzzy relations. Trajectory clustering is first employedmainly to discover the points of entry and exit of mobiles appearingin the scene. In a second step, proximity relationsbetween resulting clusters of detected mobiles and contextualelements from the scene are modeled employing fuzzyrelations. These can then be aggregated employing typicalsoft-computing algebra. A clustering algorithm based onthe transitive closure calculation of the fuzzy relations allowsbuilding the structure of the scene and characterisesthe ongoing different activities of the scene. Discovered activityzones can be reported as activity maps with differentgranularities thanks to the analysis of the transitive closurematrix. Taking advantage of the soft relation properties, activityzones and related activities can be labeled in a morehuman-like language. We present results obtained on realvideos corresponding to apron monitoring in the Toulouseairport in France.