Activity recognition through multi-scale motion detail analysis

  • Authors:
  • Youtian Du;Feng Chen;Wenli Xu;Weidong Zhang

  • Affiliations:
  • Department of Automation, Tsinghua University, Beijing 100084, China;Department of Automation, Tsinghua University, Beijing 100084, China;Department of Automation, Tsinghua University, Beijing 100084, China;Department of Automation, Tsinghua University, Beijing 100084, China

  • Venue:
  • Neurocomputing
  • Year:
  • 2008

Quantified Score

Hi-index 0.01

Visualization

Abstract

Activity recognition is one of the most challenging problems in the video content analysis and high-level computer vision. This paper proposes a novel activity recognition approach in which we decompose an activity into multiple interactive stochastic processes, each corresponding to one scale of motion details. For modeling the interactive processes, we present a hierarchical durational-state dynamic Bayesian network (HDS-DBN) to model two stochastic processes which are related to two appropriate scales in intelligent surveillance. In HDS-DBN, states are decomposed in terms of multi-scale motion details, and each kind of state indicates legible meaning. The effectiveness of this approach is demonstrated by experiments of individual activity recognition and two-person interacting activity recognition.