Segmentation and Tracking of Interacting Human Body Parts under Occlusion and Shadowing

  • Authors:
  • Sangho Park;J. K. Aggarwal

  • Affiliations:
  • -;-

  • Venue:
  • MOTION '02 Proceedings of the Workshop on Motion and Video Computing
  • Year:
  • 2002

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper presents a system to segment and track multiple bodyparts of interacting humans in the presence of mutual occlusion andshadow. The color image sequence is processed at three levels: pixellevel, blob level, and object level. A Gaussian mixture model is used atthe pixel level to train and classify individual pixel colors. MarkovRandom Field (MRF) framework is used at the blob level to merge thepixels into coherent blobs and to register inter-blob relations. Acoarse model of the human body is applied at the object level asempirical domain knowledge to resolve ambiguity due to occlusionand to recover from intermittent tracking failures. A two-fold trackingscheme is used which consists of blob to blob matching in consecutiveframes and blob to body part association within a frame. The trackingscheme resembles a multi-target, multi-assignment framework. Theresult is a tracking system that simultaneously segments and tracksmultiple body parts of interacting people. Example sequences illustratethe success of the proposed paradigm.