Linguistic estimation of topic difficulty in cross-language image retrieval

Authors:
Michael Grubinger;Clement Leung;Paul Clough
Affiliations:
School of Computer Science and Mathematics, Victoria University, Melbourne, Australia;School of Computer Science and Mathematics, Victoria University, Melbourne, Australia;Department of Information Studies, Sheffield University, Sheffield, UK
Venue:
CLEF'05 Proceedings of the 6th international conference on Cross-Language Evalution Forum: accessing Multilingual Information Repositories
Year:
2005

Citing 10
Cited 1

The informational complexity of learning from examples

The informational complexity of learning from examples
Performance evaluation in content-based image retrieval: overview and proposals

Pattern Recognition Letters - Special issue on image/video indexing and retrieval
The Language Complexity Game

The Language Complexity Game
Predicting query performance

SIGIR '02 Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval
Computational Complexity and Natural Language

Computational Complexity and Natural Language
Benchmarking for Content-Based Visual Information Search

VISUAL '00 Proceedings of the 4th International Conference on Advances in Visual Information Systems
Learning to estimate query difficulty: including applications to missing content detection and distributed information retrieval

Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval
Sentences vs. phrases: syntactic complexity in multimedia information retrieval

NLPComplexity '00 NAACL-ANLP 2000 Workshop: Syntactic and Semantic Complexity in Natural Language Processing Systems
A measure of semantic complexity for natural language systems

NLPComplexity '00 NAACL-ANLP 2000 Workshop: Syntactic and Semantic Complexity in Natural Language Processing Systems
The CLEF 2005 cross–language image retrieval track

CLEF'05 Proceedings of the 6th international conference on Cross-Language Evalution Forum: accessing Multilingual Information Repositories

Overview of the ImageCLEF 2006 photographic retrieval and object annotation tasks

CLEF'06 Proceedings of the 7th international conference on Cross-Language Evaluation Forum: evaluation of multilingual and multi-modal information retrieval

Quantified Score

Hi-index	0.01

Visualization

Abstract

Selecting suitable topics in order to assess system effectiveness is a crucial part of any benchmark, particularly those for retrieval systems. This includes establishing a range of example search requests (or topics) in order to test various aspects of the retrieval systems under evaluation. In order to assist with selecting topics, we present a measure of topic difficulty for cross-language image retrieval. This measure has enabled us to ground the topic generation process within a methodical and reliable framework for ImageCLEF 2005. This document describes such a measure for topic difficulty, providing concrete examples for every aspect of topic complexity and an analysis of topics used in the ImageCLEF 2003, 2004 and 2005 ad-hoc task.