A critical investigation of recall and precision as measures of retrieval system performance
ACM Transactions on Information Systems (TOIS)
The pragmatics of information retrieval experimentation, revisited
Information Processing and Management: an International Journal - Special issue on evaluation issues in information retrieval
A probabilistic solution to the selection and fusion problem in distributed information retrieval
Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval
Query refinement for multimedia similarity retrieval in MARS
MULTIMEDIA '99 Proceedings of the seventh ACM international conference on Multimedia (Part 1)
Performance evaluation in content-based image retrieval: overview and proposals
Pattern Recognition Letters - Special issue on image/video indexing and retrieval
Information Retrieval
A Ground-Truth Training Set for Hierarchical Clustering in Content-Based Image Retrieval
VISUAL '00 Proceedings of the 4th International Conference on Advances in Visual Information Systems
The Truth about Corel - Evaluation in Image Retrieval
CIVR '02 Proceedings of the International Conference on Image and Video Retrieval
IEEE Transactions on Image Processing
Content-based multimedia information retrieval: State of the art and challenges
ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP)
Enhancing relevance feedback in image retrieval using unlabeled data
ACM Transactions on Information Systems (TOIS)
Efficient benchmarking of content-based image retrieval via resampling
MULTIMEDIA '06 Proceedings of the 14th annual ACM international conference on Multimedia
Laplacian optimal design for image retrieval
SIGIR '07 Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval
Regularized regression on image manifold for retrieval
Proceedings of the international workshop on Workshop on multimedia information retrieval
Spectral regression: a unified subspace learning framework for content-based image retrieval
Proceedings of the 15th international conference on Multimedia
Identifying elephant photos by multi-curve matching
Pattern Recognition
Image retrieval: Ideas, influences, and trends of the new age
ACM Computing Surveys (CSUR)
Size functions for comparing 3D models
Pattern Recognition
Performance evaluation of relevance feedback methods
CIVR '08 Proceedings of the 2008 international conference on Content-based image and video retrieval
Semantic lattices for multiple annotation of images
MIR '08 Proceedings of the 1st ACM international conference on Multimedia information retrieval
Efficiently support concurrent queries in multiuser CBIR systems
Multimedia Tools and Applications
Decomposition of two-dimensional shapes for efficient retrieval
Image and Vision Computing
Image retrieval using nonlinear manifold embedding
Neurocomputing
Convex experimental design using manifold structure for image retrieval
MM '09 Proceedings of the 17th ACM international conference on Multimedia
Derivations of normalized mutual information in binary classifications
FSKD'09 Proceedings of the 6th international conference on Fuzzy systems and knowledge discovery - Volume 1
Laplacian regularized D-optimal design for active learning and its application to image retrieval
IEEE Transactions on Image Processing
Semi-supervised local discriminant embedding
ICIC'10 Proceedings of the 6th international conference on Advanced intelligent computing theories and applications: intelligent computing
Multimedia Tools and Applications
Image retrieval algorithm based on enhanced relational graph
IEA/AIE'11 Proceedings of the 24th international conference on Industrial engineering and other applications of applied intelligent systems conference on Modern approaches in applied intelligence - Volume Part I
Score distribution approach to automatic kernel selection for image retrieval systems
ISMIS'06 Proceedings of the 16th international conference on Foundations of Intelligent Systems
A complete keypics experiment with size functions
CIVR'05 Proceedings of the 4th international conference on Image and Video Retrieval
Complete performance graphs in probabilistic information retrieval
PCM'04 Proceedings of the 5th Pacific Rim Conference on Advances in Multimedia Information Processing - Volume Part II
CIVR'06 Proceedings of the 5th international conference on Image and Video Retrieval
An endmember-based distance for content based hyperspectral image retrieval
Pattern Recognition
Image retrieval based on augmented relational graph representation
Applied Intelligence
| Hi-index | 0.14 |
The performance of a Content-Based Image Retrieval (CBIR) system, presented in the form of Precision-Recall or Precision-Scope graphs, offers an incomplete overview of the system under study: The influence of the irrelevant items (embedding) is obscured. In this paper, we propose a comprehensive and well-normalized description of the ranking performance compared to the performance of an Ideal Retrieval System defined by ground-truth for a large number of predefined queries. We advocate normalization with respect to relevant class size and restriction to specific normalized scope values (the number of retrieved items). We also propose new three and two-dimensional performance graphs for total recall studies in a range of embeddings.