3D action recognition and long-term prediction of human motion

  • Authors:
  • Markus Hahn;Lars Krüger;Christian Wöhler

  • Affiliations:
  • Daimler AG Group Research, Environment Perception, Ulm, Germany;Daimler AG Group Research, Environment Perception, Ulm, Germany;Daimler AG Group Research, Environment Perception, Ulm, Germany

  • Venue:
  • ICVS'08 Proceedings of the 6th international conference on Computer vision systems
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this contribution we introduce a novel method for 3D trajectory based recognition and discrimination between different working actions and long-term motion prediction. The 3D pose of the human hand-forearm limb is tracked over time with a multi-hypothesis Kalman Filter framework using the Multiocular Contracting Curve Density algorithm (MOCCD) as a 3D pose estimation method. A novel trajectory classification approach is introduced which relies on the Levenshtein Distance on Trajectories (LDT) as a measure for the similarity between trajectories. Experimental investigations are performed on 10 real-world test sequences acquired from different viewpoints in a working environment. The system performs the simultaneous recognition of a working action and a cognitive long-term motion prediction. Trajectory recognition rates around 90% are achieved, requiring only a small number of training sequences. The proposed prediction approach yields significantly more reliable results than a Kalman Filter based reference approach.