A web-based evaluation system for CBIR
MULTIMEDIA '01 Proceedings of the 2001 ACM workshops on Multimedia: multimedia information retrieval
A compact and efficient image retrieval approach based on border/interior pixel classification
Proceedings of the eleventh international conference on Information and knowledge management
A Framework for Benchmarking in CBIR
Multimedia Tools and Applications
Multimedia Retrieval Benchmarks
IEEE MultiMedia
Evaluation axes for medical image retrieval systems: the imageCLEF experience
Proceedings of the 13th annual ACM international conference on Multimedia
Efficient benchmarking of content-based image retrieval via resampling
MULTIMEDIA '06 Proceedings of the 14th annual ACM international conference on Multimedia
An attention-driven model for grouping similar images with image retrieval applications
EURASIP Journal on Applied Signal Processing
Performance evaluation of relevance feedback methods
CIVR '08 Proceedings of the 2008 international conference on Content-based image and video retrieval
A survey of methods for image annotation
Journal of Visual Languages and Computing
The MIR flickr retrieval evaluation
MIR '08 Proceedings of the 1st ACM international conference on Multimedia information retrieval
A New Shape Benchmark for 3D Object Retrieval
ISVC '08 Proceedings of the 4th International Symposium on Advances in Visual Computing
Editorial: Special issue on image and video retrieval evaluation
Computer Vision and Image Understanding
Variation of relevance assessments for medical image retrieval
AMR'06 Proceedings of the 4th international conference on Adaptive multimedia retrieval: user, context, and feedback
Linguistic estimation of topic difficulty in cross-language image retrieval
CLEF'05 Proceedings of the 6th international conference on Cross-Language Evalution Forum: accessing Multilingual Information Repositories
How to visually retrieve images from the st. andrews collection using GIFT
CLEF'04 Proceedings of the 5th conference on Cross-Language Evaluation Forum: multilingual Information Access for Text, Speech and Images
| Hi-index | 0.00 |
The importance of the visual information search problem has given rise to a large number of systems and prototypes being built to perform such search. While different systems clearly have their particular strengths, they tend to use different collections to highlight the advantages of their algorithms. Consequently, a degree of bias may exist, and it also makes it difficult to make comparisons concerning the relative superiority of different algorithms. In order for the field of visual information search to make further progress, a need therefore exists for a standardised benchmark suite to be developed. By having a uniform measure of search performance, research progress can be more easily recognised and charted, and the resultant synergy will be essential to further development of the field. This paper presents concrete proposals concerning the development of such a benchmark, and by adopting an extensible framework, it is able to cater for a wide variety of applications paradigms and to lend itself to incremental refinement.