Global annotation on georeferenced photographs

Authors:
Jim Kleban;Emily Moxley;Jiejun Xu;B. S. Manjunath
Affiliations:
Vision Research Lab, Santa Barbara, CA;Vision Research Lab, Santa Barbara, CA;Vision Research Lab, Santa Barbara, CA;Vision Research Lab, Santa Barbara, CA
Venue:
Proceedings of the ACM International Conference on Image and Video Retrieval
Year:
2009

Citing 17
Cited 9

Introduction to MPEG-7: Multimedia Content Description Interface

Introduction to MPEG-7: Multimedia Content Description Interface
Distinctive Image Features from Scale-Invariant Keypoints

International Journal of Computer Vision
Quadtree-Based Inexact Graph Matching for Image Analysis

SIBGRAPI '05 Proceedings of the XVIII Brazilian Symposium on Computer Graphics and Image Processing
Quadtree based perceptual watermarking scheme

ASIACCS '06 Proceedings of the 2006 ACM Symposium on Information, computer and communications security
Scalable Recognition with a Vocabulary Tree

CVPR '06 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2
AnnoSearch: Image Auto-Annotation by Search

CVPR '06 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2
World explorer: visualizing aggregate data from unstructured text in geo-referenced collections

Proceedings of the 7th ACM/IEEE-CS joint conference on Digital libraries
Supervised Learning of Semantic Classes for Image Annotation and Retrieval

IEEE Transactions on Pattern Analysis and Machine Intelligence
How flickr helps us make sense of the world: context and content in community-contributed media collections

Proceedings of the 15th international conference on Multimedia
Generating diverse and representative image search results for landmarks

Proceedings of the 17th international conference on World Wide Web
Inferring generic activities and events from image content and bags of geo-tags

CIVR '08 Proceedings of the 2008 international conference on Content-based image and video retrieval
Spirittagger: a geo-aware tag suggestion tool mined from flickr

MIR '08 Proceedings of the 1st ACM international conference on Multimedia information retrieval
KNN-kernel density-based clustering for high-dimensional multivariate data

Computational Statistics & Data Analysis
Content-based image retrieval using growing hierarchical self-organizing quadtree map

Pattern Recognition
Faster graph-theoretic image processing via small-world and quadtree topologies

CVPR'04 Proceedings of the 2004 IEEE computer society conference on Computer vision and pattern recognition
Multiple Bernoulli relevance models for image and video annotation

CVPR'04 Proceedings of the 2004 IEEE computer society conference on Computer vision and pattern recognition
Sampling strategies for bag-of-features image classification

ECCV'06 Proceedings of the 9th European conference on Computer Vision - Volume Part IV

Multi-dimensional keyword-based image annotation and search

Proceedings of the 2nd International Workshop on Keyword Search on Structured Data
Geotagging in multimedia and computer vision--a survey

Multimedia Tools and Applications
Tag recommendation for georeferenced photos

Proceedings of the 3rd ACM SIGSPATIAL International Workshop on Location-Based Social Networks
Fusing concept detection and geo context for visual search

Proceedings of the 2nd ACM International Conference on Multimedia Retrieval
Exploring and browsing photos through characteristic geographic tag regions

Proceedings of the 20th ACM international conference on Multimedia
Match graph construction for large image databases

ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part I
SHIATSU: tagging and retrieving videos without worries

Multimedia Tools and Applications
Tagging photos using users' vocabularies

Neurocomputing
Uncovering locally characterizing regions within geotagged data

Proceedings of the 22nd international conference on World Wide Web

Quantified Score

Hi-index	0.00

Visualization

Abstract

We present an efficient world-scale system for providing automatic annotation on collections of geo-referenced photos. As a user uploads a photograph a place of origin is estimated from visual features which the user can refine. Once the correct location is provided, tags are suggested based on geographic and image similarity retrieved from a large database of 1.2 million images crawled from Flickr. The system effectively mines geographically relevant terms and ranks potential suggestion terms by their posterior probability given observed visual and geocoordinate features. A series of experiments analyzes the geocoordinate prediction accuracy and precision-recall metric of tags suggestions based on information retrieval techniques. The system is novel in that it fuses geographic and visual information to provide annotations for uploaded photographs taken anywhere in the world in a matter of seconds.