The MIR flickr retrieval evaluation
MIR '08 Proceedings of the 1st ACM international conference on Multimedia information retrieval
Performance measures for multilabel evaluation: a case study in the area of image classification
Proceedings of the international conference on Multimedia information retrieval
The University of Aamsterdam's concept detection system at ImageCLEF 2009
CLEF'09 Proceedings of the 10th international conference on Cross-language evaluation forum: multimedia experiments
CLEF'09 Proceedings of the 10th international conference on Cross-language evaluation forum: multimedia experiments
UAIC at ImageCLEF 2009 photo annotation task
CLEF'09 Proceedings of the 10th international conference on Cross-language evaluation forum: multimedia experiments
Learning global and regional features for photo annotation
CLEF'09 Proceedings of the 10th international conference on Cross-language evaluation forum: multimedia experiments
Improving image annotation in imbalanced classification problems with ranking SVM
CLEF'09 Proceedings of the 10th international conference on Cross-language evaluation forum: multimedia experiments
Exploring the semantics behind a collection to improve automated image annotation
CLEF'09 Proceedings of the 10th international conference on Cross-language evaluation forum: multimedia experiments
MRIM-LIG at ImageCLEF 2009: robotvision, image annotation and retrieval tasks
CLEF'09 Proceedings of the 10th international conference on Cross-language evaluation forum: multimedia experiments
Interest point and segmentation-based photo annotation
CLEF'09 Proceedings of the 10th international conference on Cross-language evaluation forum: multimedia experiments
Performance measures for multilabel evaluation: a case study in the area of image classification
Proceedings of the international conference on Multimedia information retrieval
New trends and ideas in visual concept detection: the MIR flickr retrieval evaluation initiative
Proceedings of the international conference on Multimedia information retrieval
Proceedings of the international conference on Multimedia information retrieval
Proceedings of the international conference on Multimedia information retrieval
Image retrieval using Markov Random Fields and global image features
Proceedings of the ACM International Conference on Image and Video Retrieval
The effect of semantic relatedness measures on multi-label classification evaluation
Proceedings of the ACM International Conference on Image and Video Retrieval
The University of Aamsterdam's concept detection system at ImageCLEF 2009
CLEF'09 Proceedings of the 10th international conference on Cross-language evaluation forum: multimedia experiments
CLEF'09 Proceedings of the 10th international conference on Cross-language evaluation forum: multimedia experiments
UAIC at ImageCLEF 2009 photo annotation task
CLEF'09 Proceedings of the 10th international conference on Cross-language evaluation forum: multimedia experiments
Improving image annotation in imbalanced classification problems with ranking SVM
CLEF'09 Proceedings of the 10th international conference on Cross-language evaluation forum: multimedia experiments
A fast visual word frequency - inverse image frequency for detector of rare concepts
CLEF'09 Proceedings of the 10th international conference on Cross-language evaluation forum: multimedia experiments
Exploring the semantics behind a collection to improve automated image annotation
CLEF'09 Proceedings of the 10th international conference on Cross-language evaluation forum: multimedia experiments
Interest point and segmentation-based photo annotation
CLEF'09 Proceedings of the 10th international conference on Cross-language evaluation forum: multimedia experiments
ICPR'10 Proceedings of the 20th International conference on Recognizing patterns in signals, speech, images, and videos
The university of surrey visual concept detection system at imageCLEF@ICPR: working notes
ICPR'10 Proceedings of the 20th International conference on Recognizing patterns in signals, speech, images, and videos
A hybrid supervised-unsupervised vocabulary generation algorithm for visual concept recognition
ACCV'10 Proceedings of the 10th Asian conference on Computer vision - Volume Part III
Hierarchical annotation of medical images
Pattern Recognition
Fast shared boosting for large-scale concept detection
Multimedia Tools and Applications
Pattern Recognition Letters
Hi-index | 0.00 |
The Large-Scale Visual Concept Detection and Annotation Task (LS-VCDT) in ImageCLEF 2009 aims at the detection of 53 concepts in consumer photos. These concepts are structured in an ontology which can be utilized during training and classification of the photos. The dataset consists of 18,000 Flickr photos which were manually annotated with 53 concepts. 5,000 photos were used for training and 13,000 for testing. Two evaluation paradigms have been applied, the evaluation per concept and the evaluation per photo. The evaluation per concept was performed by calculating the Equal Error Rate (EER) and the Area Under Curve (AUC). For the evaluation per photo a recently proposed ontology-based measure was utilized that takes the hierarchy and the relations of the ontology into account and calculates a score per photo. Altogether 19 research groups participated and submitted 73 runs. For the concepts, an average AUC of 84% could be achieved, including concepts with an AUC of 95%. The classification performance for each photo ranged between 68.7% and 100% with an average score of 89.6%.