Multi-layer spectral clustering for video segmentation

  • Authors:
  • Xiaofei Di;Hong Chang;Xilin Chen

  • Affiliations:
  • Key Lab of Intelligent Information Processing, Chinese Academy of Sciences (CAS), Beijing, China,Institute of Computing Technology, CAS, Beijing, China,Graduate School, Chinese Academy of Sciences ...;Key Lab of Intelligent Information Processing, Chinese Academy of Sciences (CAS), Beijing, China,Institute of Computing Technology, CAS, Beijing, China;Key Lab of Intelligent Information Processing, Chinese Academy of Sciences (CAS), Beijing, China,Institute of Computing Technology, CAS, Beijing, China

  • Venue:
  • ACCV'12 Proceedings of the 11th Asian conference on Computer Vision - Volume Part II
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

Video segmentation with spatial priority suffers from incoherence problem, since the presegments of consecutive frames may be very different. To address this problem, this paper proposes an effective and scalable approach for video segmentation, aiming to cluster video pixels that are coherent in both appearance and motion. We build up a multi-layer graph based on multiple segmentations of the video frames, where each presegment corresponds to a vertex in the graph and each layer corresponds to the segmentation result using mean shift algorithm under specific granularity. Three types of edges are connected in the graph and the corresponding affinities are defined which convey local grouping cues of intra-frame, inter-frame and inter-layer neighborhoods. Then the task of video segmentation is formulated into graph partition, which can be solved efficiently by power iteration clustering algorithm. Both qualitative and quantitative experimental results demonstrate the efficacy of our proposed method.