Shape-based image segmentation through photometric stereo

  • Authors:
  • Carme Julií;Rodrigo Moreno;Domenec Puig;Miguel Angel Garcia

  • Affiliations:
  • Universitat Rovira i Virgili, Intelligent Robotics and Computer Vision Group, Dept. of Computer Science and Mathematics, Av. Paısos Catalans 26, 43007 Tarragona, Spain;Universitat Rovira i Virgili, Intelligent Robotics and Computer Vision Group, Dept. of Computer Science and Mathematics, Av. Paısos Catalans 26, 43007 Tarragona, Spain;Universitat Rovira i Virgili, Intelligent Robotics and Computer Vision Group, Dept. of Computer Science and Mathematics, Av. Paısos Catalans 26, 43007 Tarragona, Spain;Dept. of Informatics Engineering, Universidad Autónoma de Madrid, Francisco Tomás y Valiente, 11, 28049 Madrid, Spain

  • Venue:
  • Computer Vision and Image Understanding
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper describes a new algorithm for segmenting 2D images by taking into account 3D shape information. The proposed approach consists of two stages. In the first stage, the 3D surface normals of the objects present in the scene are estimated through robust photometric stereo. Then, the image is segmented by grouping its pixels according to their estimated normals through graph-based clustering. One of the advantages of the proposed approach is that, although the segmentation is based on the 3D shape of the objects, the photometric stereo stage used to estimate the 3D normals only requires a set of 2D images. This paper provides an extensive validation of the proposed approach by comparing it with several image segmentation algorithms. Particularly, it is compared with both appearance-based image segmentation algorithms and shape-based ones. Experimental results confirm that the latter are more suitable when the objective is to segment the objects or surfaces present in the scene. Moreover, results show that the proposed approach yields the best image segmentation in most of the cases.