Towards Fully Automatic Image Segmentation Evaluation

  • Authors:
  • Lutz Goldmann;Tomasz Adamek;Peter Vajda;Mustafa Karaman;Roland Mörzinger;Eric Galmar;Thomas Sikora;Noel E. O'Connor;Thien Ha-Minh;Touradj Ebrahimi;Peter Schallauer;Benoit Huet

  • Affiliations:
  • Technical University Berlin (TUB), Berlin, Germany;Dublin City University (DCU), Dublin, Ireland;Ecole Polytechnique Federale de Lausanne (EPFL), Lausanne, Switzerland;Technical University Berlin (TUB), Berlin, Germany;Joanneum Research (JRS), Graz, Austria;Institut Eurecom, Sophia-Antipolis, France;Technical University Berlin (TUB), Berlin, Germany;Dublin City University (DCU), Dublin, Ireland;Ecole Polytechnique Federale de Lausanne (EPFL), Lausanne, Switzerland;Ecole Polytechnique Federale de Lausanne (EPFL), Lausanne, Switzerland;Joanneum Research (JRS), Graz, Austria;Institut Eurecom, Sophia-Antipolis, France

  • Venue:
  • ACIVS '08 Proceedings of the 10th International Conference on Advanced Concepts for Intelligent Vision Systems
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

Spatial region (image) segmentation is a fundamental step for many computer vision applications. Although many methods have been proposed, less work has been done in developing suitable evaluation methodologies for comparing different approaches. The main problem of general purpose segmentation evaluation is the dilemma between objectivity and generality. Recently, figure ground segmentation evaluation has been proposed to solve this problem by defining an unambiguous ground truth using the most salient foreground object. Although the annotation of a single foreground object is less complex than the annotation of all regions within an image, it is still quite time consuming, especially for videos. A novel framework incorporating background subtraction for automatic ground truth generation and different foreground evaluation measures is proposed, that allows to effectively and efficiently evaluate the performance of image segmentation approaches. The experiments show that the objective measures are comparable to the subjective assessment and that there is only a slight difference between manually annotated and automatically generated ground truth.