Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval
Learning Object Categories from Google"s Image Search
ICCV '05 Proceedings of the Tenth IEEE International Conference on Computer Vision - Volume 2
Proceedings of the 13th annual ACM international conference on Multimedia
AnnoSearch: Image Auto-Annotation by Search
CVPR '06 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2
Learned lexicon-driven interactive video retrieval
CIVR'06 Proceedings of the 5th international conference on Image and Video Retrieval
An efficient manual image annotation approach based on tagging and browsing
Workshop on multimedia information retrieval on The many faces of multimedia semantics
Proceedings of the 15th international conference on Multimedia
Generating diverse and representative image search results for landmarks
Proceedings of the 17th international conference on World Wide Web
ContextSeer: context search and recommendation at query time for shared consumer photos
MM '08 Proceedings of the 16th ACM international conference on Multimedia
SheepDog: group and tag recommendation for flickr photos by automatic search-based learning
MM '08 Proceedings of the 16th ACM international conference on Multimedia
Proceedings of the 18th international conference on World wide web
Visual tag dictionary: interpreting tags with visual words
WSMC '09 Proceedings of the 1st workshop on Web-scale multimedia corpus
WSMC '09 Proceedings of the 1st workshop on Web-scale multimedia corpus
The role of tags and image aesthetics in social image search
WSM '09 Proceedings of the first SIGMM workshop on Social media
Semantic context transfer across heterogeneous sources for domain adaptive video search
MM '09 Proceedings of the 17th ACM international conference on Multimedia
Visual categorization with negative examples for free
MM '09 Proceedings of the 17th ACM international conference on Multimedia
Smart batch tagging of photo albums
MM '09 Proceedings of the 17th ACM international conference on Multimedia
Tag quality improvement for social images
ICME'09 Proceedings of the 2009 IEEE international conference on Multimedia and Expo
Knowledge discovery over community-sharing media: from signal to intelligence
ICME'09 Proceedings of the 2009 IEEE international conference on Multimedia and Expo
Ranking canonical views for tourist attractions
Multimedia Tools and Applications
Relevance filtering meets active learning: improving web-based concept detectors
Proceedings of the international conference on Multimedia information retrieval
Proceedings of the ACM International Conference on Image and Video Retrieval
On the sampling of web images for learning visual concept classifiers
Proceedings of the ACM International Conference on Image and Video Retrieval
GameSense: game-like in-image advertising
Multimedia Tools and Applications
Unified tag analysis with multi-edge graph
Proceedings of the international conference on Multimedia
Proceedings of the international conference on Multimedia
Tag suggestion and localization in user-generated videos based on social knowledge
Proceedings of second ACM SIGMM workshop on Social media
Automatic image semantic interpretation using social action and tagging data
Multimedia Tools and Applications
Content-based tag processing for Internet social images
Multimedia Tools and Applications
Automatic generation of semantic fields for annotating web images
COLING '10 Proceedings of the 23rd International Conference on Computational Linguistics: Posters
Towards more precise social image-tag alignment
MMM'11 Proceedings of the 17th international conference on Advances in multimedia modeling - Volume Part II
Mining multi-tag association for image tagging
World Wide Web
Social negative bootstrapping for visual categorization
Proceedings of the 1st ACM International Conference on Multimedia Retrieval
Multimedia Tools and Applications
Modeling and Recognition of Landmark Image Collections Using Iconic Scene Graphs
International Journal of Computer Vision
Tag recommendation for georeferenced photos
Proceedings of the 3rd ACM SIGSPATIAL International Workshop on Location-Based Social Networks
Mining tweets for tag recommendation on social media
Proceedings of the 3rd international workshop on Search and mining user-generated contents
Enriching and localizing semantic tags in internet videos
MM '11 Proceedings of the 19th ACM international conference on Multimedia
Tag suggestion and localization for web videos by bipartite graph matching
WSM '11 Proceedings of the 3rd ACM SIGMM international workshop on Social media
Multimedia Tools and Applications
Social image search with diverse relevance ranking
MMM'10 Proceedings of the 16th international conference on Advances in Multimedia Modeling
Leveraging social media for scalable object detection
Pattern Recognition
Fusing concept detection and geo context for visual search
Proceedings of the 2nd ACM International Conference on Multimedia Retrieval
Linking visual concept detection with viewer demographics
Proceedings of the 2nd ACM International Conference on Multimedia Retrieval
Assistive tagging: A survey of multimedia tagging with human-computer joint exploration
ACM Computing Surveys (CSUR)
Where is who: large-scale photo retrieval by facial attributes and canvas layout
SIGIR '12 Proceedings of the 35th international ACM SIGIR conference on Research and development in information retrieval
What is happening: annotating images with verbs
Proceedings of the 20th ACM international conference on Multimedia
WSTRank: ranking tags to facilitate web service mining
ICSOC'12 Proceedings of the 10th international conference on Service-Oriented Computing
Fast organization of large photo collections using CUDA
ECCV'10 Proceedings of the 11th European conference on Trends and Topics in Computer Vision - Volume Part II
Tag completion based on belief theory and neighbor voting
Proceedings of the 3rd ACM conference on International conference on multimedia retrieval
Large-scale visual sentiment ontology and detectors using adjective noun pairs
Proceedings of the 21st ACM international conference on Multimedia
Hi-index | 0.00 |
In this work we explore the trade-offs in acquiring training data for image classification models through automated web search as opposed to human annotation. Automated web search comes at no cost in human labor, but sometimes leads to decreased classification performance, while human annotations come at great expense in human labor but result in better performance. The primary contribution of this work is a system for predicting which visual concepts will show the greatest increase in performance from investing human effort in obtaining annotations. We propose to build this system as an estimation of the absolute gain in average precision (AP) experienced from using human annotations instead of web search. To estimate the AP gain, we rely on statistical classifiers built on top of a number of quality prediction features. We employ a feature selection algorithm to compare the quality of each of the predictors and find that cross-domain image similarity and cross-domain model generalization metrics are strong predictors, while concept frequency and within-domain model quality are weak predictors. In a test application, we find that the prediction scheme can result in a savings in annotation effort of up to 75\%, while only incurring marginal damage (10% relative decrease in mean average precision) to the overall performance of the concept models.