Human action recognition under log-euclidean riemannian metric

  • Authors:
  • Chunfeng Yuan;Weiming Hu;Xi Li;Stephen Maybank;Guan Luo

  • Affiliations:
  • National Laboratory of Pattern Recognition, Institute of Automation, CAS, Beijing, China;National Laboratory of Pattern Recognition, Institute of Automation, CAS, Beijing, China;National Laboratory of Pattern Recognition, Institute of Automation, CAS, Beijing, China;School of Computer Science and Information Systems, Birkbeck College, London, UK;National Laboratory of Pattern Recognition, Institute of Automation, CAS, Beijing, China

  • Venue:
  • ACCV'09 Proceedings of the 9th Asian conference on Computer Vision - Volume Part I
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper presents a new action recognition approach based on local spatio-temporal features. The main contributions of our approach are twofold. First, a new local spatio-temporal feature is proposed to represent the cuboids detected in video sequences. Specifically, the descriptor utilizes the covariance matrix to capture the self-correlation information of the low-level features within each cuboid. Since covariance matrices do not lie on Euclidean space, the Log-Euclidean Riemannian metric is used for distance measure between covariance matrices. Second, the Earth Mover’s Distance (EMD) is used for matching any pair of video sequences. In contrast to the widely used Euclidean distance, EMD achieves more robust performances in matching histograms/distributions with different sizes. Experimental results on two datasets demonstrate the effectiveness of the proposed approach.