Challenges and resources for evaluating geographical IR

Authors:
Bruno Martins;Mário J. Silva;Marcirio Silveira Chaves
Affiliations:
Faculdade de Ciências da Universidade de Lisboa, Lisboa, Portugal;Faculdade de Ciências da Universidade de Lisboa, Lisboa, Portugal;Faculdade de Ciências da Universidade de Lisboa, Lisboa, Portugal
Venue:
Proceedings of the 2005 workshop on Geographic information retrieval
Year:
2005

Citing 32
Cited 7

Development of an instrument measuring user satisfaction of the human-computer interface

CHI '88 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Evaluation of the user interface in an information retrieval system: a model

Information Processing and Management: an International Journal
The R*-tree: an efficient and robust access method for points and rectangles

SIGMOD '90 Proceedings of the 1990 ACM SIGMOD international conference on Management of data
A mathematical model of the finding of usability problems

INTERCHI '93 Proceedings of the INTERCHI '93 conference on Human factors in computing systems
A method for monolingual thesauri merging

Proceedings of the 20th annual international ACM SIGIR conference on Research and development in information retrieval
Measures of relative relevance and ranked half-life: performance indicators for interactive IR

Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval
Automatic adaptation of proper noun dictionaries through cooperation of machine learning and probabilistic methods

SIGIR '00 Proceedings of the 23rd annual international ACM SIGIR conference on Research and development in information retrieval
Document centered approach to text normalization

SIGIR '00 Proceedings of the 23rd annual international ACM SIGIR conference on Research and development in information retrieval
Why batch and user evaluations do not give the same results

Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval
Spatial information retrieval and geographical ontologies an overview of the SPIRIT project

SIGIR '02 Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval
Toward the semantic geospatial web

Proceedings of the 10th ACM international symposium on Advances in geographic information systems
Computing Geographical Scopes of Web Resources

VLDB '00 Proceedings of the 26th International Conference on Very Large Data Bases
Geographical Information Retrieval with Ontologies of Place

COSIT 2001 Proceedings of the International Conference on Spatial Information Theory: Foundations of Geographic Information Science
Qualitative Spatial Representation for Information Retrieval by Gazetteers

COSIT 2001 Proceedings of the International Conference on Spatial Information Theory: Foundations of Geographic Information Science
Visual Query Processing for GIS with Web Contents

Proceedings of the IFIP TC2/WG2.6 Sixth Working Conference on Visual Database Systems: Visual and Multimedia Information Management
Classification of Web Pages with Geographic Scope and Level of Details for Mobile Cache Management

WISEW '02 Proceedings of the Third International Conference on Web Information Systems Engineering (Workshops) - (WISEw'02)
An Approach for Measuring Semantic Similarity between Words Using Multiple Information Sources

IEEE Transactions on Knowledge and Data Engineering
Named Entity recognition without gazetteers

EACL '99 Proceedings of the ninth conference on European chapter of the Association for Computational Linguistics
Where questions

ACL '79 Proceedings of the 17th annual meeting on Association for Computational Linguistics
Web-a-where: geotagging web content

Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval
Language identification in web pages

Proceedings of the 2005 ACM symposium on Applied computing
Location normalization for information extraction

COLING '02 Proceedings of the 19th international conference on Computational linguistics - Volume 1
Indexing and ranking in Geo-IR systems

Proceedings of the 2005 workshop on Geographic information retrieval
A Graph-Ranking Algorithm for Geo-Referencing Documents

ICDM '05 Proceedings of the Fifth IEEE International Conference on Data Mining
Introduction to the CoNLL-2003 shared task: language-independent named entity recognition

CONLL '03 Proceedings of the seventh conference on Natural language learning at HLT-NAACL 2003 - Volume 4
Proceedings of the HLT-NAACL 2003 workshop on Analysis of geographic references - Volume 1

HLT-NAACL-GEOREF '03 Proceedings of the HLT-NAACL 2003 workshop on Analysis of geographic references - Volume 1
Experiments with geographic knowledge for information extraction

HLT-NAACL-GEOREF '03 Proceedings of the HLT-NAACL 2003 workshop on Analysis of geographic references - Volume 1
Grounding spatial named entities for information extraction and question answering

HLT-NAACL-GEOREF '03 Proceedings of the HLT-NAACL 2003 workshop on Analysis of geographic references - Volume 1
Bootstrapping toponym classifiers

HLT-NAACL-GEOREF '03 Proceedings of the HLT-NAACL 2003 workshop on Analysis of geographic references - Volume 1
A confidence-based framework for disambiguating geographic terms

HLT-NAACL-GEOREF '03 Proceedings of the HLT-NAACL 2003 workshop on Analysis of geographic references - Volume 1
A geo-coding service encompassing a geo-parsing tool and integrated digital gazetteer service

HLT-NAACL-GEOREF '03 Proceedings of the HLT-NAACL 2003 workshop on Analysis of geographic references - Volume 1
Spatio-textual indexing for geographical search on the web

SSTD'05 Proceedings of the 9th international conference on Advances in Spatial and Temporal Databases

Indexing and ranking in Geo-IR systems

Proceedings of the 2005 workshop on Geographic information retrieval
The design and implementation of SPIRIT: a spatially aware search engine for information retrieval on the Internet

International Journal of Geographical Information Science
Extracting geographic features from the Internet to automatically build detailed regional gazetteers

International Journal of Geographical Information Science
Geographic information retrieval by topological, geographical, and conceptual matching

GeoS'07 Proceedings of the 2nd international conference on GeoSpatial semantics
The XLDB group at GeoCLEF 2005

CLEF'05 Proceedings of the 6th international conference on Cross-Language Evalution Forum: accessing Multilingual Information Repositories
Judging the spatial relevance of documents for GIR

ECIR'06 Proceedings of the 28th European conference on Advances in Information Retrieval
Blind relevance feedback and named entity based query expansion for geographic retrieval at GeoCLEF 2006

CLEF'06 Proceedings of the 7th international conference on Cross-Language Evaluation Forum: evaluation of multilingual and multi-modal information retrieval

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper discusses evaluation of Geo-IR systems, arguing for a separate study of the different algorithmic components involved. It presents existing resources for evaluating the different components, together with a review on previous results in the area.