A General Framework for Tracking Multiple People from a Moving Camera

  • Authors:
  • Wongun Choi;Caroline Pantofaru;Silvio Savarese

  • Affiliations:
  • University of Michigan, Ann Arbor, Ann Arbor;Willow Garage, Inc, Menlo Park;University of Michigan, Ann Arbor, Ann Arbor

  • Venue:
  • IEEE Transactions on Pattern Analysis and Machine Intelligence
  • Year:
  • 2013

Quantified Score

Hi-index 0.14

Visualization

Abstract

In this paper, we present a general framework for tracking multiple, possibly interacting, people from a mobile vision platform. To determine all of the trajectories robustly and in a 3D coordinate system, we estimate both the camera's ego-motion and the people's paths within a single coherent framework. The tracking problem is framed as finding the MAP solution of a posterior probability, and is solved using the reversible jump Markov chain Monte Carlo (RJ-MCMC) particle filtering method. We evaluate our system on challenging datasets taken from moving cameras, including an outdoor street scene video dataset, as well as an indoor RGB-D dataset collected in an office. Experimental evidence shows that the proposed method can robustly estimate a camera's motion from dynamic scenes and stably track people who are moving independently or interacting.