Leveraging ontologies, context and social networks to automate photo annotation

Authors:
Fergal Monaghan;David O'Sullivan
Affiliations:
Digital Enterprise Research Institute, National University of Ireland, Galway, Galway, Ireland;Digital Enterprise Research Institute, National University of Ireland, Galway, Galway, Ireland
Venue:
SAMT'07 Proceedings of the semantic and digital media technologies 2nd international conference on Semantic Multimedia
Year:
2007

Citing 4
Cited 7

Context data in geo-referenced digital photo collections

Proceedings of the 12th annual ACM international conference on Multimedia
Leveraging geo-referenced digital photographs

Leveraging geo-referenced digital photographs
CONFOTO: Browsing and annotating conference photos on the Semantic web

Web Semantics: Science, Services and Agents on the World Wide Web
Face Recognition Algorithms Surpass Humans Matching Faces Over Changes in Illumination

IEEE Transactions on Pattern Analysis and Machine Intelligence

From usage to annotation: analysis of personal photo albums for semantic photo understanding

WSM '09 Proceedings of the first SIGMM workshop on Social media
A context lifecycle for web-based context management services

EuroSSC'09 Proceedings of the 4th European conference on Smart sensing and context
A context-aware solution to annotate people in mobile devices

Proceedings of the 7th International Conference on Advances in Mobile Computing and Multimedia
Semantic analysis and retrieval in personal and social photo collections

Multimedia Tools and Applications
Scalable and distributed methods for entity matching, consolidation and disambiguation over linked data corpora

Web Semantics: Science, Services and Agents on the World Wide Web
ACRONYM: Context Metrics for Linking People to User-Generated Media Content

International Journal on Semantic Web & Information Systems
Exploiting time in automatic image tagging

ECIR'13 Proceedings of the 35th European conference on Advances in Information Retrieval

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper presents an approach to semi-automate photo annotation. Instead of using content-recognition techniques this approach leverages context information available at the scene of the photo such as time and location in combination with existing photo annotations to provide suggestions to the user. An algorithm exploits a number of technologies including Global Positioning System (GPS), Semantic Web, Web services and Online Social Networks, considering all information and making a best-effort attempt to suggest both people and places depicted in the photo. The user then selects which of the suggestions are correct to annotate the photo. This process accelerates the photo annotation process dramatically which in turn aids photo search for a wide range of query tools that currently trawl the millions of photos on the Web.