Integrating linguistic knowledge in passage retrieval for question answering

Authors:
Jörg Tiedemann
Affiliations:
University of Groningen, EK Groningen, The Netherlands
Venue:
HLT '05 Proceedings of the conference on Human Language Technology and Empirical Methods in Natural Language Processing
Year:
2005

Citing 7
Cited 7

Automatic phrase indexing for document retrieval

SIGIR '87 Proceedings of the 10th annual international ACM SIGIR conference on Research and development in information retrieval
Viewing morphology as an inference process

SIGIR '93 Proceedings of the 16th annual international ACM SIGIR conference on Research and development in information retrieval
Question-answering by predictive annotation

SIGIR '00 Proceedings of the 23rd annual international ACM SIGIR conference on Research and development in information retrieval
Monolingual Document Retrieval for European Languages

Information Retrieval
Fast statistical parsing of noun phrases for document indexing

ANLC '97 Proceedings of the fifth conference on Applied natural language processing
Information extraction for question answering: improving recall through syntactic patterns

COLING '04 Proceedings of the 20th international conference on Computational Linguistics
Experiments on robust NL question interpretation and multi-layered document annotation for a cross–language question/answering system

CLEF'04 Proceedings of the 5th conference on Cross-Language Evaluation Forum: multilingual Information Access for Text, Speech and Images

Semantic search via XML fragments: a high-precision approach to IR

SIGIR '06 Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval
An experimental study of the impact of information extraction accuracy on semantic search performance

Proceedings of the sixteenth ACM conference on Conference on information and knowledge management
Genetic algorithms for data-driven web question answering

Evolutionary Computation
Biased LexRank: Passage retrieval using random walks with question-based priors

Information Processing and Management: an International Journal
Linguistic knowledge and question answering

KRAQ '06 Proceedings of the Workshop KRAQ'06 on Knowledge and Reasoning for Language Processing
Statistical source expansion for question answering

Proceedings of the 20th ACM international conference on Information and knowledge management
Question answering for dutch using dependency relations

CLEF'05 Proceedings of the 6th international conference on Cross-Language Evalution Forum: accessing Multilingual Information Repositories

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper we investigate the use of linguistic knowledge in passage retrieval as part of an open-domain question answering system. We use annotation produced by a deep syntactic dependency parser for Dutch, Alpino, to extract various kinds of linguistic features and syntactic units to be included in a multi-layer index. Similar annotation is produced for natural language questions to be answered by the system. From this we extract query terms to be sent to the enriched retrieval index. We use a genetic algorithm to optimize the selection of features and syntactic units to be included in a query. This algorithm is also used to optimize further parameters such as keyword weights. The system is trained on questions from the competition on Dutch question answering within the Cross-Language Evaluation Forum (CLEF). We could show an improvement of about 15% in mean total reciprocal rank compared to traditional information retrieval using plain text keywords (including stemming and stop word removal).