Performance evaluation in content-based image retrieval: overview and proposals
Pattern Recognition Letters - Special issue on image/video indexing and retrieval
Modern Information Retrieval
The Truth about Corel - Evaluation in Image Retrieval
CIVR '02 Proceedings of the International Conference on Image and Video Retrieval
Retrieval evaluation with incomplete information
Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval
Scenario optimization for interactive category search
Proceedings of the 7th ACM SIGMM international workshop on Multimedia information retrieval
TREC: Experiment and Evaluation in Information Retrieval (Digital Libraries and Electronic Publishing)
Statistical precision of information retrieval evaluation
SIGIR '06 Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval
Usage-oriented multimedia information retrieval technological evaluation
MIR '06 Proceedings of the 8th ACM international workshop on Multimedia information retrieval
Human performance measures for video retrieval
MIR '06 Proceedings of the 8th ACM international workshop on Multimedia information retrieval
Benchmarking multimedia search in structured collections
MIR '06 Proceedings of the 8th ACM international workshop on Multimedia information retrieval
Evaluation campaigns and TRECVid
MIR '06 Proceedings of the 8th ACM international workshop on Multimedia information retrieval
Performance evaluation of relevance feedback methods
CIVR '08 Proceedings of the 2008 international conference on Content-based image and video retrieval
The MIR flickr retrieval evaluation
MIR '08 Proceedings of the 1st ACM international conference on Multimedia information retrieval
Sort-merge feature selection and fusion methods for classification of unstructured video
ICME'09 Proceedings of the 2009 IEEE international conference on Multimedia and Expo
Signature Quadratic Form Distance
Proceedings of the ACM International Conference on Image and Video Retrieval
Semantic analysis and retrieval in personal and social photo collections
Multimedia Tools and Applications
Evaluation platform for content-based image retrieval systems
TPDL'11 Proceedings of the 15th international conference on Theory and practice of digital libraries: research and advanced technology for digital libraries
Image similarity: from syntax to weak semantics
Multimedia Tools and Applications
AMR'10 Proceedings of the 8th international conference on Adaptive Multimedia Retrieval: context, exploration, and fusion
| Hi-index | 0.00 |
Multimedia Information Retrieval (IR)techniques and associated systems are now numerous and justify the development of strategies and actions to objectively evaluate their capabilities. A number of initiatives following this line exist, each with its own peculiarities. In this paper, we take a bird's eye view on benchmarking multimedia IR systems (with the particular case of image and video retrieval)and summarize contributions made to a dedicated special session at the ACM Multimedia Information Retrieval Workshop (ACM MIR2006).From the analysis of a classical IR system, we identify locations of interest for evaluation of performance.We review proposals made in the context of existing benchmarks, each specialized in its own aspect and media.