Ultra-wide baseline facade matching for geo-localization

  • Authors:
  • Mayank Bansal;Kostas Daniilidis;Harpreet Sawhney

  • Affiliations:
  • GRASP Lab., University of Pennsylvania, Philadelphia, PA, USA,Vision Technologies Lab., SRI International, Princeton, NJ;GRASP Lab., University of Pennsylvania, Philadelphia, PA;Vision Technologies Lab., SRI International, Princeton, NJ

  • Venue:
  • ECCV'12 Proceedings of the 12th international conference on Computer Vision - Volume Part I
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

Matching street-level images to a database of airborne images is hard because of extreme viewpoint and illumination differences. Color/gradient distributions or local descriptors fail to match forcing us to rely on the structure of self-similarity of patterns on facades. We propose to capture this structure with a novel "scale-selective self-similarity" (S4) descriptor which is computed at each point on the facade at its inherent scale. To achieve this, we introduce a new method for scale selection which enables the extraction and segmentation of facades as well. Matching is done with a Bayesian classification of the street-view query S4 descriptors given all labeled descriptors in the bird's-eye-view database. We show experimental results on retrieval accuracy on a challenging set of publicly available imagery and compare with standard SIFT-based techniques.