Visualization and clustering of crowd video content in MPCA subspace

  • Authors:
  • Haiping Lu;How-Lung Eng;Myo Thida;Konstantinos N. Plataniotis

  • Affiliations:
  • Institute for Infocomm Research, Agency for Science, Technology and Research, Singapore, Singapore;Institute for Infocomm Research, Agency for Science, Technology and Research, Singapore, Singapore;Institute for Infocomm Research, Agency for Science, Technology and Research, Singapore, Singapore;University of Toronto, Toronto, ON, Canada

  • Venue:
  • CIKM '10 Proceedings of the 19th ACM international conference on Information and knowledge management
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper presents a novel approach for the visualization and clustering of crowd video contents by using multilinear principal component analysis (MPCA). In contrast to feature-point-based approach and frame-based dimensionality reduction approach, the proposed method maps each short video segment to a point in MPCA subspace to take temporal information into account naturally through tensorial representations. Specifically, MPCA projects each short segment of a video to a low-dimensional tensor first. A few MPCA features are then selected according to the variance captured as the final representation. Thus, a video is visualized as a trajectory in MPCA subspace. The trajectory generated enables visual interpretation of video content in a compact space as well as visual clustering of video events. The proposed method is evaluated on the PETS 2009 datasets through comparison with three existing methods for video visualization. The MPCA visualization shows superior performance in clustering segments of the same event as well as identifying the transitions between events.