Automatic tag expansion using visual similarity for photo sharing websites

Authors:
Sare Gul Sevil;Onur Kucuktunc;Pinar Duygulu;Fazli Can
Affiliations:
Department of Computer Engineering, Bilkent University, Ankara, Turkey 06800;Department of Computer Engineering, Bilkent University, Ankara, Turkey 06800;Department of Computer Engineering, Bilkent University, Ankara, Turkey 06800;Department of Computer Engineering, Bilkent University, Ankara, Turkey 06800
Venue:
Multimedia Tools and Applications
Year:
2010

Citing 23
Cited 9

Content-Based Image Retrieval at the End of the Early Years

IEEE Transactions on Pattern Analysis and Machine Intelligence
MiAlbum - a system for home photo managemet using the semi-automatic image annotation approach

MULTIMEDIA '00 Proceedings of the eighth ACM international conference on Multimedia
Object Recognition as Machine Translation: Learning a Lexicon for a Fixed Image Vocabulary

ECCV '02 Proceedings of the 7th European Conference on Computer Vision-Part IV
Multiple-Instance Learning for Natural Scene Classification

ICML '98 Proceedings of the Fifteenth International Conference on Machine Learning
Automatic image annotation and retrieval using cross-media relevance models

Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval
Modeling annotated data

Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval
Automatic Linguistic Indexing of Pictures by a Statistical Modeling Approach

IEEE Transactions on Pattern Analysis and Machine Intelligence
Matching words and pictures

The Journal of Machine Learning Research
Distinctive Image Features from Scale-Invariant Keypoints

International Journal of Computer Vision
PLSA-based image auto-annotation: constraining the latent space

Proceedings of the 12th annual ACM international conference on Multimedia
Formulating Semantic Image Annotation as a Supervised Learning Problem

CVPR '05 Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 2 - Volume 02
AutoTag: a collaborative approach to automated tag assignment for weblog posts

Proceedings of the 15th international conference on World Wide Web
HT06, tagging paper, taxonomy, Flickr, academic article, to read

Proceedings of the seventeenth conference on Hypertext and hypermedia
AnnoSearch: Image Auto-Annotation by Search

CVPR '06 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2
Engineering and utilizing a stopword list in Greek Web retrieval

Journal of the American Society for Information Science and Technology
Flickr tag recommendation based on collective knowledge

Proceedings of the 17th international conference on World Wide Web
World-scale mining of objects and events from community photo collections

CIVR '08 Proceedings of the 2008 international conference on Content-based image and video retrieval
VisualRank: Applying PageRank to Large-Scale Image Search

IEEE Transactions on Pattern Analysis and Machine Intelligence
80 Million Tiny Images: A Large Data Set for Nonparametric Object and Scene Recognition

IEEE Transactions on Pattern Analysis and Machine Intelligence
Tag recommendations in social bookmarking systems

AI Communications
Automatic image annotation using visual content and folksonomies

Multimedia Tools and Applications
Learning social tag relevance by neighbor voting

IEEE Transactions on Multimedia
Multiple Bernoulli relevance models for image and video annotation

CVPR'04 Proceedings of the 2004 IEEE computer society conference on Computer vision and pattern recognition

Tag suggestion and localization in user-generated videos based on social knowledge

Proceedings of second ACM SIGMM workshop on Social media
Tag refinement in an image folksonomy using visual similarity and tag co-occurrence statistics

Image Communication
Web video retagging

Multimedia Tools and Applications
Tag recommendation for georeferenced photos

Proceedings of the 3rd ACM SIGSPATIAL International Workshop on Location-Based Social Networks
Assistive tagging: A survey of multimedia tagging with human-computer joint exploration

ACM Computing Surveys (CSUR)
Topic based photo set retrieval using user annotated tags

Multimedia Tools and Applications
Content-based tag propagation and tensor factorization for personalized item recommendation based on social tagging

ACM Transactions on Interactive Intelligent Systems (TiiS)
Landmark image annotation using textual and geolocation metadata

Proceedings of the 10th Conference on Open Research Areas in Information Retrieval
Collaborative topic regression with social regularization for tag recommendation

IJCAI'13 Proceedings of the Twenty-Third international joint conference on Artificial Intelligence

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper we present an automatic photo tag expansion method designed for photo sharing websites. The purpose of the method is to suggest tags that are relevant to the visual content of a given photo at upload time. Both textual and visual cues are used in the process of tag expansion. When a photo is to be uploaded, the system asks for a couple of initial tags from the user. The initial tags are used to retrieve relevant photos together with their tags. These photos are assumed to be potentially content related to the uploaded target photo. The tag sets of the relevant photos are used to form the candidate tag list, and visual similarities between the target photo and relevant photos are used to give weights to these candidate tags. Tags with the highest weights are suggested to the user. The method is applied on Flickr ( http://www.flickr.com ). Results show that including visual information in the process of photo tagging increases accuracy with respect to text-based methods.