Online video segmentation by bayesian split-merge clustering

  • Authors:
  • Juho Lee;Suha Kwak;Bohyung Han;Seungjin Choi

  • Affiliations:
  • Department of Computer Science and Engineering, Pohang University of Science and Technology, Pohang, Korea;Department of Computer Science and Engineering, Pohang University of Science and Technology, Pohang, Korea;Department of Computer Science and Engineering, Pohang University of Science and Technology, Pohang, Korea, Department of Creative IT Excellence Engineering, Pohang University of Science and Techn ...;Department of Computer Science and Eng., Pohang Univ. of Science and Techn., Pohang, Korea, Division of IT Convergence Eng., Pohang Univ. of Science and Techn., Pohang, Korea, Dept. of Creative IT ...

  • Venue:
  • ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part IV
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

We present an online video segmentation algorithm based on a novel nonparametric Bayesian clustering method called Bayesian Split-Merge Clustering (BSMC). BSMC can efficiently cluster dynamically changing data through split and merge processes at each time step, where the decision for splitting and merging is made by approximate posterior distributions over partitions with Dirichlet Process (DP) priors. Moreover, BSMC sidesteps the difficult problem of finding the proper number of clusters by virtue of the flexibility of nonparametric Bayesian models. We naturally apply BSMC to online video segmentation, which is composed of three steps--pixel clustering, histogram-based merging and temporal matching. We demonstrate the performance of our algorithm on complex real video sequences compared to other existing methods.