Using Temporal Coherence to Build Models of Animals

  • Authors:
  • Deva Ramanan;D. A. Forsyth

  • Affiliations:
  • -;-

  • Venue:
  • ICCV '03 Proceedings of the Ninth IEEE International Conference on Computer Vision - Volume 2
  • Year:
  • 2003

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper describes a system that can build appearance models ofanimals automatically from a video sequence of the relevant animalwith no explicit supervisory information. The video sequence neednot have any form of special background. Animals are modeled as a2D kinematic chain of rectangular segments, where the number ofsegments and the topology of the chain are unknown. The systemdetects possible segments, clusters segments whose appearance iscoherent over time, and then builds a spatial model of such segmentclusters. The resulting representation of the spatial configurationof the animal in each frame can be seen either as a track - inwhich case the system described should be viewed as a generalizedtracker, that is capable of modeling objects while tracking them -or as the source of an appearance model which can be used to builddetectors for the particular animal. This is because knowing avideo sequence is temporally coherent - i.e. that a particularanimal is present through the sequence - is a strong supervisorysignal. The method is shown to be successful as a tracker on videosequences of real scenes showing three different animals. For thesame reason it is successful as a tracker, the method results indetectors that can be used to find each animal fairly reliablywithin the Corel collection of images.