Learning compact visual descriptor for low bit rate mobile landmark search

  • Authors:

  • Rongrong Ji;Ling-Yu Duan;Jie Chen;Hongxun Yao;Tiejun Huang;Wen Gao

  • Affiliations:

  • Institute of Digital Media, Peking University, Beijing, China and Visual Intelligence Laboratory, Harbin Institute of Technology, Heilongjiang, China;Institute of Digital Media, Peking University, Beijing, China;Institute of Digital Media, Peking University, Beijing, China;Visual Intelligence Laboratory, Harbin Institute of Technology, Heilongjiang, China;Institute of Digital Media, Peking University, Beijing, China;Institute of Digital Media, Peking University, Beijing, China and Visual Intelligence Laboratory, Harbin Institute of Technology, Heilongjiang, China

  • Venue:
  • IJCAI'11 Proceedings of the Twenty-Second international joint conference on Artificial Intelligence - Volume Volume Three
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper, we propose to extract a compact yet discriminative visual descriptor directly on the mobile device, which tackles the wireless query transmission latency in mobile landmark search. This descriptor originates from offline learning the location contexts of geo-tagged Web photos from both Flickr and Panoramio with two phrases: First, we segment the landmark photo collections into discrete geographical regions using a Gaussian Mixture Model [Stauffer et al., 2000]. Second, a ranking sensitive vocabulary boosting is introduced to learn a compact codebook within each region. To tackle the locally optimal descriptor learning caused by imprecise geographical segmentation, we further iterate above phrases incorporating the feedback of an "entropy" based descriptor compactness into a prior distribution to constrain the Gaussian mixture modeling. Consequently, when entering a specific geographical region, the codebook in the mobile device is downstream adapted, which ensures efficient extraction of compact descriptors, its low bit rate transmission, as well as promising discrimination ability. We descriptors to both HTC and iPhone mobile phones, testing landmark search over one million images in typical areas like Beijing, New York, and Barcelona, etc. Our descriptor outperforms alternative compact descriptors [Chen et al., 2009][Chen et al., 2010][Chandrasekhar et al., 2009a][Chandrasekhar et al., 2009b] with a large margin.