Kernel analysis on Grassmann manifolds for action recognition

  • Authors:

  • Mehrtash T. Harandi;Conrad Sanderson;Sareh Shirazi;Brian C. Lovell

  • Affiliations:

  • NICTA, Locked Bag 8001, Canberra ACT 2601, Australia and The University of Queensland, School of ITEE, QLD 4072, Australia;NICTA, PO Box 6020, St Lucia QLD 4067, Australia and Queensland University of Technology (QUT), Brisbane QLD 4000, Australia;NICTA, PO Box 6020, St Lucia QLD 4067, Australia and The University of Queensland, School of ITEE, QLD 4072, Australia;The University of Queensland, School of ITEE, QLD 4072, Australia

  • Venue:
  • Pattern Recognition Letters
  • Year:
  • 2013

Quantified Score

Hi-index 0.10

Visualization

Abstract

Modelling video sequences by subspaces has recently shown promise for recognising human actions. Subspaces are able to accommodate the effects of various image variations and can capture the dynamic properties of actions. Subspaces form a non-Euclidean and curved Riemannian manifold known as a Grassmann manifold. Inference on manifold spaces usually is achieved by embedding the manifolds in higher dimensional Euclidean spaces. In this paper, we instead propose to embed the Grassmann manifolds into reproducing kernel Hilbert spaces and then tackle the problem of discriminant analysis on such manifolds. To achieve efficient machinery, we propose graph-based local discriminant analysis that utilises within-class and between-class similarity graphs to characterise intra-class compactness and inter-class separability, respectively. Experiments on KTH, UCF Sports, and Ballet datasets show that the proposed approach obtains marked improvements in discrimination accuracy in comparison to several state-of-the-art methods, such as the kernel version of affine hull image-set distance, tensor canonical correlation analysis, spatial-temporal words and hierarchy of discriminative space-time neighbourhood features.