View-invariant human activity recognition based on shape and motion features

  • Authors:
  • F. Niu;M. Abdel-Mottaleb

  • Affiliations:
  • University of Miami, Coral Gables, FL;University of Miami, Coral Gables, FL

  • Venue:
  • International Journal of Robotics and Automation
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

Recognizing human activities from image sequences is an active area of research in computer vision. Most of the previous approaches on activity recognition focus on recognition from a single view and ignore the issue of view invariance, and they deal with recognizing a single activity. There are only few published algorithms for segmenting and recognizing complex activities that are composed of more than one activity. In this paper, we present a view invariant human activity recognition approach that uses both motion and shape information. An augmented vector of both optical flow features as well as eigen shape features is used to represent motion and shape of the body in the region of interest in each frame of the sequence. Each activity is represented by a set of hidden Markov models, where each model represents the activity from a different viewing direction, to realize the view invariance. Also, we present a voting-based approach to automatically and effectively segment and recognize complex activities. Experiments on two sets of video clips of different activities show that our method is effective.