Action recognition with multiscale spatio-temporal contexts

  • Authors:
  • Jiang Wang; Zhuoyuan Chen; Ying Wu

  • Affiliations:
  • EECS Dept., Northwestern Univ., Evanston, IL, USA;EECS Dept., Northwestern Univ., Evanston, IL, USA;EECS Dept., Northwestern Univ., Evanston, IL, USA

  • Venue:
  • CVPR '11 Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

The popular bag of words approach for action recognition is based on the classifying quantized local features density. This approach focuses excessively on the local features but discards all information about the interactions among them. Local features themselves may not be discriminative enough, but combined with their contexts, they can be very useful for the recognition of some actions. In this paper, we present a novel representation that captures contextual interactions between interest points, based on the density of all features observed in each interest point's mutliscale spatio-temporal contextual domain. We demonstrate that augmenting local features with our contextual feature significantly improves the recognition performance.