Using syntactic dependency as local context to resolve word sense ambiguity
ACL '98 Proceedings of the 35th Annual Meeting of the Association for Computational Linguistics and Eighth Conference of the European Chapter of the Association for Computational Linguistics
Image region entropy: a measure of "visualness" of web images associated with one concept
Proceedings of the 13th annual ACM international conference on Multimedia
Image annotations by combining multiple evidence & wordNet
Proceedings of the 13th annual ACM international conference on Multimedia
Usage patterns of collaborative tagging systems
Journal of Information Science
Content-based multimedia information retrieval: State of the art and challenges
ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP)
To search or to label?: predicting the performance of search-based automatic image classifiers
MIR '06 Proceedings of the 8th ACM international workshop on Multimedia information retrieval
Why we tag: motivations for annotation in mobile and online media
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
The Google Similarity Distance
IEEE Transactions on Knowledge and Data Engineering
Flickr tag recommendation based on collective knowledge
Proceedings of the 17th international conference on World Wide Web
Real-Time Computerized Annotation of Pictures
IEEE Transactions on Pattern Analysis and Machine Intelligence
80 Million Tiny Images: A Large Data Set for Nonparametric Object and Scene Recognition
IEEE Transactions on Pattern Analysis and Machine Intelligence
MM '08 Proceedings of the 16th ACM international conference on Multimedia
Online multi-label active annotation: towards large-scale content-based video search
MM '08 Proceedings of the 16th ACM international conference on Multimedia
Classifying tags using open content resources
Proceedings of the Second ACM International Conference on Web Search and Data Mining
Proceedings of the 18th international conference on World wide web
Semi-supervised multi-label learning by constrained non-negative matrix factorization
AAAI'06 Proceedings of the 21st national conference on Artificial intelligence - Volume 1
MM '09 Proceedings of the 17th ACM international conference on Multimedia
Tag quality improvement for social images
ICME'09 Proceedings of the 2009 IEEE international conference on Multimedia and Expo
Boost search relevance for tag-based social image retrieval
ICME'09 Proceedings of the 2009 IEEE international conference on Multimedia and Expo
Retagging social images based on visual and semantic consistency
Proceedings of the 19th international conference on World wide web
Unified tag analysis with multi-edge graph
Proceedings of the international conference on Multimedia
Image tag refinement towards low-rank, content-tag prior and error sparsity
Proceedings of the international conference on Multimedia
Content-based tag processing for Internet social images
Multimedia Tools and Applications
Mining multi-tag association for image tagging
World Wide Web
Finding media illustrating events
Proceedings of the 1st ACM International Conference on Multimedia Retrieval
Exploiting user information for image tag refinement
MM '11 Proceedings of the 19th ACM international conference on Multimedia
Automatic image tagging through information propagation in a query log based graph structure
MM '11 Proceedings of the 19th ACM international conference on Multimedia
Personalizing automated image annotation using cross-entropy
MM '11 Proceedings of the 19th ACM international conference on Multimedia
Music retagging using label propagation and robust principal component analysis
Proceedings of the 21st international conference companion on World Wide Web
Proceedings of the 2nd ACM International Conference on Multimedia Retrieval
Assistive tagging: A survey of multimedia tagging with human-computer joint exploration
ACM Computing Surveys (CSUR)
Harvesting visual concepts for image search with complex queries
Proceedings of the 20th ACM international conference on Multimedia
Multi-view learning from imperfect tagging
Proceedings of the 20th ACM international conference on Multimedia
On sparse and low-rank matrix decomposition for singing voice separation
Proceedings of the 20th ACM international conference on Multimedia
Semantic context learning with large-scale weakly-labeled image set
Proceedings of the 21st ACM international conference on Information and knowledge management
Discriminative factor alignment across heterogeneous feature space
ECML PKDD'12 Proceedings of the 2012 European conference on Machine Learning and Knowledge Discovery in Databases - Volume Part II
Social tag enrichment via automatic abstract tag refinement
PCM'12 Proceedings of the 13th Pacific-Rim conference on Advances in Multimedia Information Processing
Multimedia information retrieval on the social web
Proceedings of the 22nd international conference on World Wide Web companion
Learning with limited and noisy tagging
Proceedings of the 21st ACM international conference on Multimedia
Metadata enrichment for news video retrieval: a graph-based propagation approach
Proceedings of the 21st ACM international conference on Multimedia
Learning to Recommend Descriptive Tags for Questions in Social Forums
ACM Transactions on Information Systems (TOIS)
Semantic context based refinement for news video annotation
Multimedia Tools and Applications
ObjectPatchNet: Towards scalable and semantic image annotation and retrieval
Computer Vision and Image Understanding
Automatic Abstract Tag Detection for Social Image Tag Refinement and Enrichment
Journal of Signal Processing Systems
Hi-index | 0.00 |
Online social media repositories such as Flickr and Zooomr allow users to manually annotate their images with freely-chosen tags, which are then used as indexing keywords to facilitate image search and other applications. However, these tags are frequently imprecise and incomplete, though they are provided by human beings, and many of them are almost only meaningful for the image owners (such as the name of a dog). Thus there is still a gap between these tags and the actual content of the images, and this significantly limits tag-based applications, such as search and browsing. To tackle this issue, this paper proposes a social image "retagging" scheme that aims at assigning images with better content descriptors. The refining process, including denoising and enriching, is formulated as an optimization framework based on the consistency between "visual similarity" and "semantic similarity" in social images, that is, the visually similar images tend to have similar semantic descriptors, and vice versa. An effective iterative bound optimization algorithm is applied to learn the improved tag assignment. In addition, as many tags are intrinsically not closely-related to the visual content of the images, we employ knowledge based method to differentiate visual content related tags from unrelated ones and then constrain the tagging vocabulary of our automatic algorithm within the content related tags. Finally, to improve the coverage of the tags, we further enrich the tag set with appropriate synonyms and hypernyms based on an external knowledge base. Experimental results on a Flickr image collection demonstrate the effectiveness of this approach. We will also show the remarkable performance improvements brought by retagging via two applications, i.e., tag-based search and automatic annotation.