Tag refinement in an image folksonomy using visual similarity and tag co-occurrence statistics

Authors:
Sihyoung Lee;Wesley De Neve;Yong Man Ro
Affiliations:
Image and Video Systems Lab, Korea Advanced Institute of Science and Technology (KAIST), Yuseong-gu, Daejeon, South Korea;Image and Video Systems Lab, Korea Advanced Institute of Science and Technology (KAIST), Yuseong-gu, Daejeon, South Korea;Image and Video Systems Lab, Korea Advanced Institute of Science and Technology (KAIST), Yuseong-gu, Daejeon, South Korea
Venue:
Image Communication
Year:
2010

Citing 30
Cited 3

Cumulated gain-based evaluation of IR techniques

ACM Transactions on Information Systems (TOIS)
Introduction to MPEG-7: Multimedia Content Description Interface

Introduction to MPEG-7: Multimedia Content Description Interface
Labeling images with a computer game

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Distinctive Image Features from Scale-Invariant Keypoints

International Journal of Computer Vision
Image annotations by combining multiple evidence & wordNet

Proceedings of the 13th annual ACM international conference on Multimedia
A Texture-Based Method for Modeling the Background and Detecting Moving Objects

IEEE Transactions on Pattern Analysis and Machine Intelligence
Region-based Image Annotation using Asymmetrical Support Vector Machine-based Multiple-Instance Learning

CVPR '06 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2
Why we tag: motivations for annotation in mobile and online media

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Towards automatic extraction of event and place semantics from flickr tags

SIGIR '07 Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval
Semantic-associative visual content labelling and retrieval: A multimodal approach

Image Communication
Features for image retrieval: an experimental comparison

Information Retrieval
Flickr tag recommendation based on collective knowledge

Proceedings of the 17th international conference on World Wide Web
Tag Recommendations in Folksonomies

PKDD 2007 Proceedings of the 11th European conference on Principles and Practice of Knowledge Discovery in Databases
Toward Bridging the Annotation-Retrieval Gap in Image Search

IEEE MultiMedia
Resolving tag ambiguity

MM '08 Proceedings of the 16th ACM international conference on Multimedia
Image annotation using personal calendars as context

MM '08 Proceedings of the 16th ACM international conference on Multimedia
The MIR flickr retrieval evaluation

MIR '08 Proceedings of the 1st ACM international conference on Multimedia information retrieval
Automatic image annotation using visual content and folksonomies

Multimedia Tools and Applications
Tag ranking

Proceedings of the 18th international conference on World wide web
Learning to tag

Proceedings of the 18th international conference on World wide web
WordNet: similarity - measuring the relatedness of concepts

AAAI'04 Proceedings of the 19th national conference on Artifical intelligence
NUS-WIDE: a real-world web image database from National University of Singapore

Proceedings of the ACM International Conference on Image and Video Retrieval
Scale-rotation invariant pattern entropy for keypoint-based near-duplicate detection

IEEE Transactions on Image Processing
Tag quality improvement for social images

ICME'09 Proceedings of the 2009 IEEE international conference on Multimedia and Expo
Learning social tag relevance by neighbor voting

IEEE Transactions on Multimedia
MAP-based image tag recommendation using a visual folksonomy

Pattern Recognition Letters
Automatic tag expansion using visual similarity for photo sharing websites

Multimedia Tools and Applications
Multiple Bernoulli relevance models for image and video annotation

CVPR'04 Proceedings of the 2004 IEEE computer society conference on Computer vision and pattern recognition
SURF: speeded up robust features

ECCV'06 Proceedings of the 9th European conference on Computer Vision - Volume Part I
CBSA: content-based soft annotation for multimodal image retrieval using Bayes point machines

IEEE Transactions on Circuits and Systems for Video Technology

Reading between the tags to predict real-world size-class for visually depicted objects in images

MM '11 Proceedings of the 19th ACM international conference on Multimedia
Towards data-driven estimation of image tag relevance using visually similar and dissimilar folksonomy images

Proceedings of the 2012 international workshop on Socially-aware multimedia
Web media semantic concept retrieval via tag removal and model fusion

ACM Transactions on Intelligent Systems and Technology (TIST) - Survey papers, special sections on the semantic adaptive social web, intelligent systems for health informatics, regular papers

Quantified Score

Hi-index	0.00

Visualization

Abstract

Noisy tag assignments lower the effectiveness of multimedia applications that rely on the availability of user-supplied tags for retrieving user-contributed images for further processing. This paper discusses a novel tag refinement technique that aims at differentiating noisy tag assignments from correct tag assignments. The correctness of tag assignments is determined through the combined use of visual similarity and tag co-occurrence statistics. To verify the effectiveness of our tag refinement technique, experiments were performed with user-contributed images retrieved from Flickr. For the image set used, the proposed tag refinement technique reduces the number of noisy tag assignments with 36% (benefit), while removing 10% of the correct tag assignments (cost). In addition, our tag refinement technique increases the effectiveness of tag recommendation for non-annotated images with 45% when using the P@5 metric and with 41% when using the NDCG metric.