Heritage app: annotating images on mobile phones

  • Authors:
  • Jayaguru Panda;Shashank Sharma;C. V. Jawahar

  • Affiliations:
  • IIIT-Hyderabad, India;IIIT-Hyderabad, India;IIIT-Hyderabad, India

  • Venue:
  • Proceedings of the Eighth Indian Conference on Computer Vision, Graphics and Image Processing
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper, we demonstrate a computer vision application on mobile phones. One can take a picture at a heritage site/monument and obtain associated annotations on a mid-end mobile phone instantly. This does not require any communication of images or features with a remote server, and all the necessary computations take place on the phone itself. We demonstrate the app on two Indian heritage sites: Golkonda Fort and Hampi Temples. Underlying our application, we have a Bag of visual Words (BoW) image retrieval system, and an annotated database of images. In the process of developing this mobile app, we extend the performance, scope and applicability of computer vision techniques: (i) we do a BoW-based image retrieval on mobile phones from a database of 10K images within 50 MB of storage and 10 MB of RAM. (ii) we introduce a vocabulary pruning method for reducing the vocabulary size. (iii) we design a simple method of database pruning, that helps in reducing the size of the inverted index by removing semantically similar images. In (ii) and (iii), we demonstrate how memory(RAM) and computational speed can be optimized without any loss in performance.