Object Recognition as Machine Translation: Learning a Lexicon for a Fixed Image Vocabulary
ECCV '02 Proceedings of the 7th European Conference on Computer Vision-Part IV
The Truth about Corel - Evaluation in Image Retrieval
CIVR '02 Proceedings of the International Conference on Image and Video Retrieval
Automatic image annotation and retrieval using cross-media relevance models
Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval
The Journal of Machine Learning Research
Labeling images with a computer game
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Learning to Detect Objects in Images via a Sparse, Part-Based Representation
IEEE Transactions on Pattern Analysis and Machine Intelligence
CVPRW '04 Proceedings of the 2004 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'04) Volume 12 - Volume 12
Object Categorization by Learned Universal Visual Dictionary
ICCV '05 Proceedings of the Tenth IEEE International Conference on Computer Vision - Volume 2
Probabilistic models of text and images
Probabilistic models of text and images
Peekaboom: a game for locating objects in images
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Pattern Recognition and Machine Learning (Information Science and Statistics)
Pattern Recognition and Machine Learning (Information Science and Statistics)
Semantic Modeling of Natural Scenes for Content-Based Image Retrieval
International Journal of Computer Vision
Supervised Learning of Semantic Classes for Image Annotation and Retrieval
IEEE Transactions on Pattern Analysis and Machine Intelligence
LabelMe: A Database and Web-Based Tool for Image Annotation
International Journal of Computer Vision
Evaluation of Localized Semantics: Data, Methodology, and Experiments
International Journal of Computer Vision
Image retrieval: Ideas, influences, and trends of the new age
ACM Computing Surveys (CSUR)
Overview of the ImageCLEFphoto 2007 Photographic Retrieval Task
Advances in Multilingual and Multimodal Information Retrieval
Overview of the ImageCLEF 2007 Object Retrieval Task
Advances in Multilingual and Multimodal Information Retrieval
EMMCVPR'07 Proceedings of the 6th international conference on Energy minimization methods in computer vision and pattern recognition
Markov random fields and spatial information to improve automatic image annotation
PSIVT'07 Proceedings of the 2nd Pacific Rim conference on Advances in image and video technology
The visual concept detection task in ImageCLEF 2008
CLEF'08 Proceedings of the 9th Cross-language evaluation forum conference on Evaluating systems for multilingual and multimodal information access
Annotation-based expansion and late fusion of mixed methods for multimedia image retrieval
CLEF'08 Proceedings of the 9th Cross-language evaluation forum conference on Evaluating systems for multilingual and multimodal information access
ECCV'06 Proceedings of the 9th European conference on Computer Vision - Volume Part I
Overview of the ImageCLEF 2006 photographic retrieval and object annotation tasks
CLEF'06 Proceedings of the 7th international conference on Cross-Language Evaluation Forum: evaluation of multilingual and multi-modal information retrieval
Editorial: Special issue on image and video retrieval evaluation
Computer Vision and Image Understanding
Annotation-based expansion and late fusion of mixed methods for multimedia image retrieval
CLEF'08 Proceedings of the 9th Cross-language evaluation forum conference on Evaluating systems for multilingual and multimodal information access
Large-scale text to image retrieval using a Bayesian K-neighborhood model
SSPR&SPR'10 Proceedings of the 2010 joint IAPR international conference on Structural, syntactic, and statistical pattern recognition
Data fusion and label weighting for image retrieval based on spatio-conceptual information
RIAO '10 Adaptivity, Personalization and Fusion of Heterogeneous Information
Custom ontologies for an automated image annotation system
KES'11 Proceedings of the 15th international conference on Knowledge-based and intelligent information and engineering systems - Volume Part I
Fusing object detection and region appearance for image-text alignment
MM '11 Proceedings of the 19th ACM international conference on Multimedia
Multimodal indexing based on semantic cohesion for image retrieval
Information Retrieval
Multi-modal region selection approach for training object detectors
Proceedings of the 2nd ACM International Conference on Multimedia Retrieval
Image annotation by semantic sparse recoding of visual content
Proceedings of the 20th ACM international conference on Multimedia
Random forest for image annotation
ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part VI
Local image tagging via graph regularized joint group sparsity
Pattern Recognition
Improving image retrieval by using spatial relations
Multimedia Tools and Applications
Using tagged images of low visual ambiguity to boost the learning efficiency of object detectors
Proceedings of the 21st ACM international conference on Multimedia
| Hi-index | 0.00 |
Automatic image annotation (AIA), a highly popular topic in the field of information retrieval research, has experienced significant progress within the last decade. Yet, the lack of a standardized evaluation platform tailored to the needs of AIA, has hindered effective evaluation of its methods, especially for region-based AIA. Therefore in this paper, we introduce the segmented and annotated IAPR TC-12 benchmark; an extended resource for the evaluation of AIA methods as well as the analysis of their impact on multimedia information retrieval. We describe the methodology adopted for the manual segmentation and annotation of images, and present statistics for the extended collection. The extended collection is publicly available and can be used to evaluate a variety of tasks in addition to image annotation. We also propose a soft measure for the evaluation of annotation performance and identify future research areas in which this extended test collection is likely to make a contribution.