Measuring effectiveness of geographic IR systems in digital libraries: evaluation framework and case study

Authors:
Damien Palacio;Guillaume Cabanac;Christian Sallaberry;Gilles Hubert
Affiliations:
Université de Pau et des Pays de l'Adour, LIUPPA, Pau Cedex;Université de Toulouse, IRIT, UMR, CNRS, Toulouse Cedex 9;Université de Pau et des Pays de l'Adour, LIUPPA, Pau Cedex;Université de Toulouse, IRIT, UMR, CNRS, Toulouse Cedex 9
Venue:
ECDL'10 Proceedings of the 14th European conference on Research and advanced technology for digital libraries
Year:
2010

Citing 28
Cited 1

On ordered weighted averaging aggregation operators in multicriteria decisionmaking

IEEE Transactions on Systems, Man and Cybernetics
Using statistical testing in the evaluation of retrieval experiments

SIGIR '93 Proceedings of the 16th annual international ACM SIGIR conference on Research and development in information retrieval
GIPSY: automated geographic indexing of text documents

Journal of the American Society for Information Science - Special issue: spatial information
Analyses of multiple evidence combination

Proceedings of the 20th annual international ACM SIGIR conference on Research and development in information retrieval
Cumulated gain-based evaluation of IR techniques

ACM Transactions on Information Systems (TOIS)
Introduction

CLEF '00 Revised Papers from the Workshop of Cross-Language Evaluation Forum on Cross-Language Information Retrieval and Evaluation
Indexing and ranking in Geo-IR systems

Proceedings of the 2005 workshop on Geographic information retrieval
Geographic reference analysis for geographic document querying

HLT-NAACL-GEOREF '03 Proceedings of the HLT-NAACL 2003 workshop on Analysis of geographic references - Volume 1
TREC: Experiment and Evaluation in Information Retrieval (Digital Libraries and Electronic Publishing)

TREC: Experiment and Evaluation in Information Retrieval (Digital Libraries and Electronic Publishing)
GIR'05 2005 ACM workshop on geographical information retrieval

ACM SIGIR Forum
A global process to access documents' contents from a geographical point of view

Journal of Visual Languages and Computing
STEWARD: architecture of a spatio-textual search engine

Proceedings of the 15th annual ACM international symposium on Advances in geographic information systems
Analysis of geographic queries in a search engine log

Proceedings of the first international workshop on Location and the web
An outranking approach for information retrieval

Information Retrieval
Introduction to Information Retrieval

Introduction to Information Retrieval
Comparing Several Textual Information Retrieval Systems for the Geographical Information Retrieval Task

NLDB '08 Proceedings of the 13th international conference on Natural Language and Information Systems: Applications of Natural Language to Information Systems
Improving Temporal Language Models for Determining Time of Non-timestamped Documents

ECDL '08 Proceedings of the 12th European conference on Research and Advanced Technology for Digital Libraries
Geographic intention and modification in web search

International Journal of Geographical Information Science
Multidimensional Relevance: A New Aggregation Criterion

ECIR '09 Proceedings of the 31th European Conference on IR Research on Advances in Information Retrieval
An adaptable search engine for multimodal information retrieval

Journal of the American Society for Information Science and Technology
Providing Universal Access to History Textbooks: A Modified GIS Case

W2GIS '09 Proceedings of the 9th International Symposium on Web and Wireless Geographical Information Systems
Searching in a book

ECDL'09 Proceedings of the 13th European conference on Research and advanced technology for digital libraries
Geographic information retrieval and digital libraries

ECDL'09 Proceedings of the 13th European conference on Research and advanced technology for digital libraries
GeoCLEF: the CLEF 2005 cross-language geographic information retrieval track overview

CLEF'05 Proceedings of the 6th international conference on Cross-Language Evalution Forum: accessing Multilingual Information Repositories
Terrier information retrieval platform

ECIR'05 Proceedings of the 27th European conference on Advances in Information Retrieval Research
Spatio-textual indexing for geographical search on the web

SSTD'05 Proceedings of the 9th international conference on Advances in Spatial and Temporal Databases
Judging the spatial relevance of documents for GIR

ECIR'06 Proceedings of the 28th European conference on Advances in Information Retrieval
Empirical evaluation of semi-automated XML annotation of text documents with the GoldenGATE editor

ECDL'07 Proceedings of the 11th European conference on Research and Advanced Technology for Digital Libraries

Query operators shown beneficial for improving search results

TPDL'11 Proceedings of the 15th international conference on Theory and practice of digital libraries: research and advanced technology for digital libraries

Quantified Score

Hi-index	0.00

Visualization

Abstract

Common search engines process users' queries (i.e., information needs) by retrieving documents from pre-built term-based indexes. For digital libraries, such approaches are limited regarding particular contexts, such as specialized collections (e.g., cultural heritage collections) or specific retrieval criteria (e.g., multidimensional criteria). In this paper, we consider Information Retrieval systems exploiting geographic dimensions: spatial, temporal, and topical dimensions. Our contribution is twofold as we propose a Geographic Information Retrieval system evaluation framework and test the following hypothesis: combining spatial and temporal dimensions along with the topical dimension improves the effectiveness of Information Retrieval systems.