Coaction discovery: segmentation of common actions across multiple videos

  • Authors:
  • Caiming Xiong;Jason J. Corso

  • Affiliations:
  • SUNY at Buffalo, Buffalo, NY;SUNY at Buffalo, Buffalo, NY

  • Venue:
  • Proceedings of the Twelfth International Workshop on Multimedia Data Mining
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

We introduce a new problem called coaction discovery: the task of discovering and segmenting the common actions (coactions) between videos that may contain several actions. This paper presents an approach for coaction discovery; the key idea of our approach is to compute an action proposal map for each video based jointly on dynamic object-motion and static appearance semantics, and unsupervisedly cluster each video into atomic action clips, called actoms. Subsequently, we use a temporally coherent discriminative clustering framework for extracting the coactions. We apply our coaction discovery approach to two datasets and demonstrate convincing and superior performance to three baseline methods.