Using structural patches tiling to guide human head-shoulder segmentation

  • Authors:
  • Pengyang Bu;Nan Wang;Haizhou Ai

  • Affiliations:
  • Tsinghua University, Beijing, China;Tsinghua University, Beijing, China;Tsinghua University, Beijing, China

  • Venue:
  • Proceedings of the 20th ACM international conference on Multimedia
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper, we propose a novel and effective structural patches tiling procedure which is able to generate high quality probabilistic masks to guide semantic segmentation. In this structural patches tiling procedure, we first apply a local patch structure classifier trained by random forest to the input image in a sliding window manner, and then construct an MRF iteratively optimized to assemble a high quality probabilistic mask from responses collected from the previous stage. Our main contributions are twofold: A patch-based classification procedure which is fast and capable of capturing rich local structures compared with pixel-based ones; a flexible Markovian sliding window merging algorithm which integrates context information into traditional sliding window method. Without loss of generality, we use head-shoulder segmentation to illustrate this procedure's power. Experiments on daily photos and comparisons with previous work demonstrate that we are able to achieve state-of-the-art head-shoulder segmentation results thanks to this structural patches tiling procedure.