Unsupervised Learning of Skeletons from Motion

  • Authors:
  • David A. Ross;Daniel Tarlow;Richard S. Zemel

  • Affiliations:
  • University of Toronto, Canada;University of Toronto, Canada;University of Toronto, Canada

  • Venue:
  • ECCV '08 Proceedings of the 10th European Conference on Computer Vision: Part III
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

Humans demonstrate a remarkable ability to parse complicated motion sequences into their constituent structures and motions. We investigate this problem, attempting to learn the structure of one or more articulated objects, given a time-series of two-dimensional feature positions. We model the observed sequence in terms of "stick figure" objects, under the assumption that the relative joint angles between sticks can change over time, but their lengths and connectivities are fixed. We formulate the problem in a single probabilistic model that includes multiple sub-components: associating the features with particular sticks, determining the proper number of sticks, and finding which sticks are physically joined. We test the algorithm on challenging datasets of 2D projections of optical human motion capture and feature trajectories from real videos.