Recovering real-world images from single-scale boundaries with a novel filling-in architecture

  • Authors:
  • Matthias S. Keil;Gabriel Cristóbal;Thorsten Hansen;Heiko Neumann

  • Affiliations:
  • Centre de Visió per Computador, Edifici O, Campus UAB, E-08193 Bellaterra (Cerdanyola), Barcelona, Spain;Instituto de íptica (CSIC), Image and Vision Department, E-28006 Madrid, Spain;Universität Giessen, Department of Psychology, D-35394 Giessen, Germany;Universität Ulm, Abteilung Neuroinformatik, D-89069 Ulm, Germany

  • Venue:
  • Neural Networks
  • Year:
  • 2005

Quantified Score

Hi-index 0.00

Visualization

Abstract

Filling-in models were successful in predicting psychophysical data for brightness perception. Nevertheless, their suitability for real-world image processing has never been examined. A unified architecture for both predicting psychophysical data and real-world image processing would constitute a powerful theory for early visual information processing. As a first contribution of the present paper, we identified three principal problems with current filling-in architectures, which hamper the goal of having such a unified architecture. To overcome these problems we propose an advance to filling-in theory, called BEATS filling-in, which is based on a novel nonlinear diffusion operator. BEATS filling-in furthermore introduces novel boundary structures. We compare, by means of simulation studies with real-world images, the performance of BEATS filling-in with the recently proposed confidence-based filling-in. As a second contribution we propose a novel mechanism for encoding luminance information in contrast responses ('multiplex contrasts'), which is based on recent neurophysiological findings. Again, by simulations, we show that 'multiplex contrasts' at a single, high-resolution filter scale are sufficient for recovering absolute luminance levels. Hence, 'multiplex contrasts' represent a novel theory addressing how the brain encodes and decodes luminance information.