Efficient mobile landmark recognition based on saliency-aware scalable vocabulary tree

  • Authors:
  • Kim-Hui Yap;Zhen Li;Da-Jiang Zhang;Zhan-Ke Ng

  • Affiliations:
  • Nanyang Technological University, Singapore, Singapore;Nanyang Technological University, Singapore, Singapore;Nanyang Technological University, Singapore, Singapore;Nanyang Technological University, Singapore, Singapore

  • Venue:
  • Proceedings of the 20th ACM international conference on Multimedia
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

In recent years, the Scalable Vocabulary Tree (SVT) has been shown to be effective in image recognition. However, in mobile landmark image recognition where the foreground is the landmark to be recognized while the background is cluttered, the current SVT framework ignores different local importance of image, hence restricting its performance. In this paper, we propose a new landmark recognition framework that can incorporate saliency information to improve the recognition performance relative to the baseline SVT method. Specifically, the saliency information is incorporated in three phases: image descriptor calculation, vocabulary tree generation, and image representation. We constructed a city-scale landmark dataset in Singapore, and the experimental results show that the proposed mobile landmark recognition by incorporating saliency information outperforms the baseline SVT recognition by about 9%.