Labelling Image Regions Using Wavelet Features and Spatial Prototypes

  • Authors:

  • Carsten Saathoff;Marcin Grzegorzek;Steffen Staab

  • Affiliations:

  • ISWeb --- Information Systems and Semantic Web Research Group Institute for Computer Science, University of Koblenz --- Landau,;ISWeb --- Information Systems and Semantic Web Research Group Institute for Computer Science, University of Koblenz --- Landau,;ISWeb --- Information Systems and Semantic Web Research Group Institute for Computer Science, University of Koblenz --- Landau,

  • Venue:
  • SAMT '08 Proceedings of the 3rd International Conference on Semantic and Digital Media Technologies: Semantic Multimedia
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper we present an approach for image region classification that combines low-level processing with high-level scene understanding. For the low-level training, predefined image concepts are statistically modelled using wavelet features extracted directly from image pixels. For classification, features of a given test region compared with these statistical models provide probabilistic evaluations for all possible image concepts. Maximising these values themselves already leads to a classification result (label). However, in our paper they are used as an input for the high-level approach exploiting explicitly represented spatial arrangements of labels, so called spatial prototypes. We formalise the problem using Fuzzy Constraint Satisfaction Problems and Linear Programming. They provide a model with explicit knowledge that is suitable to aid the task of region labelling. Experiments performed for nearly 6000 test image regions show that combining low-level and high-level image analysis increases the labelling accuracy significantly.