Journal of Global Optimization
Object Recognition from Local Scale-Invariant Features
ICCV '99 Proceedings of the International Conference on Computer Vision-Volume 2 - Volume 2
Geometry-based Automatic Object Localization and 3-D Pose Detection
SSIAI '02 Proceedings of the Fifth IEEE Southwest Symposium on Image Analysis and Interpretation
Photo tourism: exploring photo collections in 3D
ACM SIGGRAPH 2006 Papers
Photos for information: a field study of cameraphone computer vision interactions in tourism
CHI '08 Extended Abstracts on Human Factors in Computing Systems
Outdoors augmented reality on mobile phone using loxel-based visual feature organization
MIR '08 Proceedings of the 1st ACM international conference on Multimedia information retrieval
CrowdSearch: exploiting crowds for accurate real-time image search on mobile phones
Proceedings of the 8th international conference on Mobile systems, applications, and services
Visual Navigation for Mobile Devices
IEEE MultiMedia
Building book inventories using smartphones
Proceedings of the international conference on Multimedia
TagSense: a smartphone-based approach to automatic image tagging
MobiSys '11 Proceedings of the 9th international conference on Mobile systems, applications, and services
SURF: speeded up robust features
ECCV'06 Proceedings of the 9th European conference on Computer Vision - Volume Part I
Machine learning for high-speed corner detection
ECCV'06 Proceedings of the 9th European conference on Computer Vision - Volume Part I
Demo: satellites in our pockets: an object positioning system using smartphones
Proceedings of the 10th international conference on Mobile systems, applications, and services
Tagging cities?: reading RFID tags from inside brick and mortar
Proceedings of the 10th ACM Conference on Embedded Network Sensor Systems
If you see something, swipe towards it: crowdsourced event localization using smartphones
Proceedings of the 2013 ACM international joint conference on Pervasive and ubiquitous computing
FOCUS: clustering crowdsourced videos by line-of-sight
Proceedings of the 11th ACM Conference on Embedded Networked Sensor Systems
Hi-index | 0.00 |
This paper attempts to solve the following problem: can a distant object be localized by looking at it through a smartphone. As an example use-case, while driving on a highway entering New York, we want to look at one of the skyscrapers through the smartphone camera, and compute its GPS location. While the problem would have been far more difficult five years back, the growing number of sensors on smartphones, combined with advances in computer vision, have opened up important opportunities. We harness these opportunities through a system called Object Positioning System (OPS) that achieves reasonable localization accuracy. Our core technique uses computer vision to create an approximate 3D structure of the object and camera, and applies mobile phone sensors to scale and rotate the structure to its absolute configuration. Then, by solving (nonlinear) optimizations on the residual (scaling and rotation) error, we ultimately estimate the object's GPS position. We have developed OPS on Android NexusS phones and experimented with localizing 50 objects in the Duke University campus. We believe that OPS shows promising results, enabling a variety of applications. Our ongoing work is focused on coping with large GPS errors, which proves to be the prime limitation of the current prototype.