Sequential deep learning for human action recognition

  • Authors:
  • Moez Baccouche;Franck Mamalet;Christian Wolf;Christophe Garcia;Atilla Baskurt

  • Affiliations:
  • Orange Labs, Cesson-Sévigné, France;Orange Labs, Cesson-Sévigné, France;LIRIS, UMR 5205 CNRS, INSA-Lyon, France;LIRIS, UMR 5205 CNRS, INSA-Lyon, France;LIRIS, UMR 5205 CNRS, INSA-Lyon, France

  • Venue:
  • HBU'11 Proceedings of the Second international conference on Human Behavior Unterstanding
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

We propose in this paper a fully automated deep model, which learns to classify human actions without using any prior knowledge. The first step of our scheme, based on the extension of Convolutional Neural Networks to 3D, automatically learns spatio-temporal features. A Recurrent Neural Network is then trained to classify each sequence considering the temporal evolution of the learned features for each timestep. Experimental results on the KTH dataset show that the proposed approach outperforms existing deep models, and gives comparable results with the best related works.