A multi-layer MRF model for video object segmentation

  • Authors:
  • Zoltan Kato;Ting-Chuen Pong

  • Affiliations:
  • Institute of Informatics, University of Szeged, Szeged, Hungary;Computer Science Department, Hong Kong University of Science and Technology, Kowloon, Hong Kong, China

  • Venue:
  • ACCV'06 Proceedings of the 7th Asian conference on Computer Vision - Volume Part II
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

A novel video object segmentation method is proposed which aims at combining color and motion information. The model has a multi-layer structure: Each feature has its own layer, called feature layer, where a classical Markov random field (MRF) image segmentation model is defined using only the corresponding feature. A special layer is assigned to the combined MRF model, called combined layer, which interacts with each feature layer and provides the segmentation based on the combination of different features. Unlike previous methods, our approach doesn’t assume motion boundaries being part of spatial ones. Therefore a very important property of the proposed method is the ability to detect boundaries that are visible only in the motion feature as well as those visible only in the color one. The method is validated on synthetic and real video sequences.