Similarity constrained latent support vector machine: an application to weakly supervised action classification

  • Authors:
  • Nataliya Shapovalova;Arash Vahdat;Kevin Cannons;Tian Lan;Greg Mori

  • Affiliations:
  • School of Computing Science, Simon Fraser University, Canada;School of Computing Science, Simon Fraser University, Canada;School of Computing Science, Simon Fraser University, Canada;School of Computing Science, Simon Fraser University, Canada;School of Computing Science, Simon Fraser University, Canada

  • Venue:
  • ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part VII
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

We present a novel algorithm for weakly supervised action classification in videos. We assume we are given training videos annotated only with action class labels. We learn a model that can classify unseen test videos, as well as localize a region of interest in the video that captures the discriminative essence of the action class. A novel Similarity Constrained Latent Support Vector Machine model is developed to operationalize this goal. This model specifies that videos should be classified correctly, and that the latent regions of interest chosen should be coherent over videos of an action class. The resulting learning problem is challenging, and we show how dual decomposition can be employed to render it tractable. Experimental results demonstrate the efficacy of the method.