Combinatorial enlargement of ground-truth datasets and efficient evaluation of segmentation algorithms

  • Authors:
  • Akhil R. Shah;Siddhartha R. Dalal

  • Affiliations:
  • RAND Corporation, Santa Monica, California;RAND Corporation, Santa Monica, California

  • Venue:
  • Proceedings of the 1st International Workshop on Visual Interfaces for Ground Truth Collection in Computer Vision Applications
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

We propose a method to exponentially enlarge a small dataset of domain specific ground truth segmentation labels to evaluate the performance of segmentation algorithms. Furthermore, we adapt ideas from combinatorial software testing to efficiently infer statistics of segmentation performance by evaluating performance on only a certain subset of the combinatorially generated images. Extensions of this work to optimal sequence for performance testing and algorithm selection are also suggested.