Human group activity analysis with fusion of motion and appearance information

  • Authors:
  • Zhongwei Cheng;Lei Qin;Qingming Huang;Shuqiang Jiang;Shuicheng Yan;Qi Tian

  • Affiliations:
  • Graduate University of Chinese Academy of Sciences, Beijing, China;Institute of Computing Technology, CAS, Beijing, China;Graduate University of Chinese Academy of Sciences & Institute of Computing Technology, CAS, Beijing, China;Institute of Computing Technology, CAS, Beijing, China;National University of Singapore, Singapore, Singapore;University of Texas at San Antonio, San Antonio, TX, USA

  • Venue:
  • MM '11 Proceedings of the 19th ACM international conference on Multimedia
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

Human activity analysis is an important and challenging task in video content analysis and understanding. In this paper, we focus on the activity of small human group, which involves countable persons and complex interactions. To cope with the variant number of participants and inherent interactions within the activity, we propose a hierarchical model with three layers to depict the characteristics at different granularities. In traditional methods, group activity is represented mainly based on motion information, such as human trajectories, but ignoring discriminative appearance information, e.g. the rough sketch of a pose style. In our approach, we take advantage of both the motion and the appearance information in the spatiotemporal activity context under the hierarchical model. These features are inhomogeneous. Therefore, we employ multiple kernel learning methods to fuse the features for group activity recognition. Experiments on a surveillance-like human group activity database demonstrate the validity of our approach and the recognition performance is promising.