Introduction to statistical pattern recognition (2nd ed.)
Introduction to statistical pattern recognition (2nd ed.)
Content-Based Image Retrieval at the End of the Early Years
IEEE Transactions on Pattern Analysis and Machine Intelligence
Object Recognition as Machine Translation: Learning a Lexicon for a Fixed Image Vocabulary
ECCV '02 Proceedings of the 7th European Conference on Computer Vision-Part IV
Automatic image annotation and retrieval using cross-media relevance models
Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval
Convergence of alternating optimization
Neural, Parallel & Scientific Computations
Distinctive Image Features from Scale-Invariant Keypoints
International Journal of Computer Vision
A novel log-based relevance feedback technique in content-based image retrieval
Proceedings of the 12th annual ACM international conference on Multimedia
Multi-level annotation of natural scenes using dominant image components and semantic concepts
Proceedings of the 12th annual ACM international conference on Multimedia
Formulating Semantic Image Annotation as a Supervised Learning Problem
CVPR '05 Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 2 - Volume 02
Learning a Mahalanobis Metric from Equivalence Constraints
The Journal of Machine Learning Research
Photo tourism: exploring photo collections in 3D
ACM SIGGRAPH 2006 Papers
Learning Distance Metrics with Contextual Constraints for Image Retrieval
CVPR '06 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2
AnnoSearch: Image Auto-Annotation by Search
CVPR '06 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2
Efficient Learning of Label Ranking by Soft Projections onto Polyhedra
The Journal of Machine Learning Research
Supervised Learning of Semantic Classes for Image Annotation and Retrieval
IEEE Transactions on Pattern Analysis and Machine Intelligence
Information-theoretic metric learning
Proceedings of the 24th international conference on Machine learning
Scene completion using millions of photographs
ACM SIGGRAPH 2007 papers
LabelMe: A Database and Web-Based Tool for Image Annotation
International Journal of Computer Vision
Proceedings of the 17th international conference on World Wide Web
Automatic image annotation via local multi-label classification
CIVR '08 Proceedings of the 2008 international conference on Content-based image and video retrieval
Learning to reduce the semantic gap in web image retrieval and annotation
Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval
Combinational collaborative filtering for personalized community recommendation
Proceedings of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining
MM '08 Proceedings of the 16th ACM international conference on Multimedia
An efficient algorithm for local distance metric learning
AAAI'06 Proceedings of the 21st national conference on Artificial intelligence - Volume 1
Semi-supervised learning for image annotation based on conditional random fields
CIVR'06 Proceedings of the 5th international conference on Image and Video Retrieval
Non-parametric kernel ranking approach for social image retrieval
Proceedings of the ACM International Conference on Image and Video Retrieval
Semantics-preserving bag-of-words models and applications
IEEE Transactions on Image Processing
S3MKL: scalable semi-supervised multiple kernel learning for image data mining
Proceedings of the international conference on Multimedia
Nearest-neighbor classification using unlabeled data for real world image application
Proceedings of the international conference on Multimedia
Learning contextual metrics for automatic image annotation
PCM'10 Proceedings of the 11th Pacific Rim conference on Advances in multimedia information processing: Part I
Collection-based sparse label propagation and its application on social group suggestion from photos
ACM Transactions on Intelligent Systems and Technology (TIST)
Distance metric learning from uncertain side information for automated photo tagging
ACM Transactions on Intelligent Systems and Technology (TIST)
Mining social images with distance metric learning for automated image tagging
Proceedings of the fourth ACM international conference on Web search and data mining
A two-view learning approach for image tag ranking
Proceedings of the fourth ACM international conference on Web search and data mining
Mining multi-tag association for image tagging
World Wide Web
Probabilistic image tagging with tags expanded by text-based search
DASFAA'11 Proceedings of the 16th international conference on Database systems for advanced applications - Volume Part I
Mining weakly labeled web facial images for search-based face annotation
Proceedings of the 34th international ACM SIGIR conference on Research and development in Information Retrieval
Tagging image by exploring weighted correlation between visual features and tags
WAIM'11 Proceedings of the 12th international conference on Web-age information management
Modeling social strength in social media community via kernel-based learning
MM '11 Proceedings of the 19th ACM international conference on Multimedia
Personalizing automated image annotation using cross-entropy
MM '11 Proceedings of the 19th ACM international conference on Multimedia
Tag suggestion and localization for web videos by bipartite graph matching
WSM '11 Proceedings of the 3rd ACM SIGMM international workshop on Social media
Multimedia Tools and Applications
Local image tagging via graph regularized joint group sparsity
Pattern Recognition
Online multi-modal distance learning for scalable multimedia retrieval
Proceedings of the sixth ACM international conference on Web search and data mining
Improving image tags by exploiting web search results
Multimedia Tools and Applications
Exploiting user comments for audio-visual content indexing and retrieval
ECIR'13 Proceedings of the 35th European conference on Advances in Information Retrieval
Learning to name faces: a multimodal learning scheme for search-based face annotation
Proceedings of the 36th international ACM SIGIR conference on Research and development in information retrieval
Hi-index | 0.00 |
Automated photo tagging is essential to make massive unlabeled photos searchable by text search engines. Conventional image annotation approaches, though working reasonably well on small testbeds, are either computationally expensive or inaccurate when dealing with large-scale photo tagging. Recently, with the popularity of social networking websites, we observe a massive number of user-tagged images, referred to as "social images", that are available on the web. Unlike traditional web images, social images often contain tags and other user-generated content, which offer a new opportunity to resolve some long-standing challenges in multimedia. In this work, we aim to address the challenge of large-scale automated photo tagging by exploring the social images. We present a retrieval based approach for automated photo tagging. To tag a test image, the proposed approach first retrieves k social images that share the largest visual similarity with the test image. The tags of the test image are then derived based on the tagging of the similar images. Due to the well-known semantic gap issue, a regular Euclidean distance-based retrieval method often fails to find semantically relevant images. To address the challenge of semantic gap, we propose a novel probabilistic distance metric learning scheme that (1) automatically derives constraints from the uncertain side information, and (2) efficiently learns a distance metric from the derived constraints. We apply the proposed technique to automated photo tagging tasks based on a social image testbed with over 200,000 images crawled from Flickr. Encouraging results show that the proposed technique is effective and promising for automated photo tagging.