Segmentation from a box

  • Authors:
  • Leo Grady;Marie-Pierre Jolly;Aaron Seitz

  • Affiliations:
  • Siemens Corporate Research-Image Analytics and Informatics, 755 College Rd., Princeton NJ, USA;Siemens Corporate Research-Image Analytics and Informatics, 755 College Rd., Princeton NJ, USA;University of California Riverside-Department of Psychology, 900 University Ave., USA

  • Venue:
  • ICCV '11 Proceedings of the 2011 International Conference on Computer Vision
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

Drawing a box around an intended segmentation target has become both a popular user interface and a common output for learning-driven detection algorithms. Despite the ubiquity of using a box to define a segmentation target, it is unclear in the literature whether a box is sufficient to define a unique segmentation or whether segmentation from a box is ill-posed without higher-level (semantic) knowledge of the intended target. We examine this issue by conducting a study of 14 subjects who are asked to segment a boxed target in a set of 50 real images for which they have no semantic attachment. We find that the subjects do indeed perceive and trace almost the same segmentations as each other, despite the inhomogeneity of the image intensities, irregular shapes of the segmentation targets and weakness of the target boundaries. Since the subjects produce the same segmentation, we conclude that the problem is well-posed and then provide a new segmentation algorithm from a box which achieves results close to the perceived target.