Multiple view geometry in computer visiond
Multiple view geometry in computer visiond
Video Google: A Text Retrieval Approach to Object Matching in Videos
ICCV '03 Proceedings of the Ninth IEEE International Conference on Computer Vision - Volume 2
An Efficient Solution to the Five-Point Relative Pose Problem
IEEE Transactions on Pattern Analysis and Machine Intelligence
Distinctive Image Features from Scale-Invariant Keypoints
International Journal of Computer Vision
Photo tourism: exploring photo collections in 3D
ACM SIGGRAPH 2006 Papers
Scalable Recognition with a Vocabulary Tree
CVPR '06 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2
Image Based Localization in Urban Environments
3DPVT '06 Proceedings of the Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06)
Modeling and Recognition of Landmark Image Collections Using Iconic Scene Graphs
ECCV '08 Proceedings of the 10th European Conference on Computer Vision: Part I
Proceedings of the 18th international conference on World wide web
ViewFocus: explore places of interests on Google maps using photos with view direction filtering
MM '09 Proceedings of the 17th ACM international conference on Multimedia
Efficiently locating photographs in many panoramas
Proceedings of the 18th SIGSPATIAL International Conference on Advances in Geographic Information Systems
Retrieving landmark and non-landmark images from community photo collections
Proceedings of the international conference on Multimedia
Spatial coding for large scale partial-duplicate web image search
Proceedings of the international conference on Multimedia
Beyond GPS: determining the camera viewing direction of a geotagged image
Proceedings of the international conference on Multimedia
Avoiding confusing features in place recognition
ECCV'10 Proceedings of the 11th European conference on Computer vision: Part I
Location recognition using prioritized feature matching
ECCV'10 Proceedings of the 11th European conference on Computer vision: Part II
Accurate image localization based on google maps street view
ECCV'10 Proceedings of the 11th European conference on Computer vision: Part IV
Descriptor learning for efficient retrieval
ECCV'10 Proceedings of the 11th European conference on computer vision conference on Computer vision: Part III
Geotagging in multimedia and computer vision--a survey
Multimedia Tools and Applications
The social camera: a case-study in contextual image recommendation
Proceedings of the 16th international conference on Intelligent user interfaces
When recommendation meets mobile: contextual and personalized recommendation on the go
Proceedings of the 13th international conference on Ubiquitous computing
Active query sensing for mobile location search
MM '11 Proceedings of the 19th ACM international conference on Multimedia
Towards low bit rate mobile visual search with multiple-channel coding
MM '11 Proceedings of the 19th ACM international conference on Multimedia
Location Discriminative Vocabulary Coding for Mobile Landmark Search
International Journal of Computer Vision
What makes Paris look like Paris?
ACM Transactions on Graphics (TOG) - SIGGRAPH 2012 Conference Proceedings
City-scale landmark identification on mobile devices
CVPR '11 Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition
Fast image-based localization using direct 2D-to-3D matching
ICCV '11 Proceedings of the 2011 International Conference on Computer Vision
Contextual weighting for vocabulary tree based image retrieval
ICCV '11 Proceedings of the 2011 International Conference on Computer Vision
Proceedings of the 20th ACM international conference on Multimedia
Query specific fusion for image retrieval
ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part II
Hi-index | 0.00 |
Mobile applications are becoming increasingly popular. More and more people are using their phones to enjoy ubiquitous location-based services (LBS). The increasing popularity of LBS creates a fundamental problem: mobile localization. Besides traditional localization methods that use GPS or wireless signals, using phone-captured images for localization has drawn significant interest from researchers. Photos contain more scene context information than the embedded sensors, leading to a more precise location description. With the goal being to accurately sense real geographic scene contexts, this article presents a novel approach to mobile visual localization according to a given image (typically associated with a rough GPS position). The proposed approach is capable of providing a complete set of more accurate parameters about the scene geo-context including the real locations of both the mobile user and perhaps more importantly the captured scene, as well as the viewing direction. To figure out how to make image localization quick and accurate, we investigate various techniques for large-scale image retrieval and 2D-to-3D matching. Specifically, we first generate scene clusters using joint geo-visual clustering, with each scene being represented by a reconstructed 3D model from a set of images. The 3D models are then indexed using a visual vocabulary tree structure. Taking geo-tags of the database image as prior knowledge, a novel location-based codebook weighting scheme proposed to embed this additional information into the codebook. The discriminative power of the codebook is enhanced, thus leading to better image retrieval performance. The query image is aligned with the models obtained from the image retrieval results, and eventually registered to a real-world map. We evaluate the effectiveness of our approach using several large-scale datasets and achieving estimation accuracy of a user's location within 13 meters, viewing direction within 12 degrees, and viewing distance within 26 meters. Of particular note is our showcase of three novel applications based on localization results: (1) an on-the-spot tour guide, (2) collaborative routing, and (3) a sight-seeing guide. The evaluations through user studies demonstrate that these applications are effective in facilitating the ideal rendezvous for mobile users.