A word clustering approach for language model-based sentence retrieval in question answering systems

Authors:
Saeedeh Momtazi;Dietrich Klakow
Affiliations:
University of Saarland, Saarbrücken, Germany;University of Saarland, Saarbrücken, Germany
Venue:
Proceedings of the 18th ACM conference on Information and knowledge management
Year:
2009

Citing 11
Cited 8

Class-based n-gram models of natural language

Computational Linguistics
TREC and TIPSTER experiments with INQUERY

TREC-2 Proceedings of the second conference on Text retrieval conference
A language modeling approach to information retrieval

Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval
A general language model for information retrieval (poster abstract)

Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval
A study of smoothing methods for language models applied to Ad Hoc information retrieval

Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval
Word clustering and disambiguation based on co-occurrence data

Natural Language Engineering
Dependence language model for information retrieval

Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval
A class-based language model for large-vocabulary speech recognition extracted from part-of-speech statistics

ICASSP '99 Proceedings of the Acoustics, Speech, and Signal Processing, 1999. on 1999 IEEE International Conference - Volume 01
A method for query expansion using a hierarchy of clusters

AIRS'05 Proceedings of the Second Asia conference on Asia Information Retrieval Technology
Exploring syntactic relation patterns for question answering

IJCNLP'05 Proceedings of the Second international joint conference on Natural Language Processing
Automatic word clustering for text categorization using global information

AIRS'04 Proceedings of the 2004 international conference on Asian Information Retrieval Technology

A comparative study of word co-occurrence for term clustering in language model-based sentence retrieval

HLT '10 Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics
Effective term weighting for sentence retrieval

ECDL'10 Proceedings of the 14th European conference on Research and advanced technology for digital libraries
Integrating history-length interpolation and classes in language modeling

HLT '11 Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies - Volume 1
Informative sentence retrieval for domain specific terminologies

IEA/AIE'11 Proceedings of the 24th international conference on Industrial engineering and other applications of applied intelligent systems conference on Modern approaches in applied intelligence - Volume Part I
Trained trigger language model for sentence retrieval in QA: bridging the vocabulary gap

Proceedings of the 20th ACM international conference on Information and knowledge management
Half-context language models

Computational Linguistics
Rel-grams: a probabilistic model of relations in text

AKBC-WEKEX '12 Proceedings of the Joint Workshop on Automatic Knowledge Base Construction and Web-scale Knowledge Extraction
Class-Based language models for chinese-english parallel corpus

CICLing'13 Proceedings of the 14th international conference on Computational Linguistics and Intelligent Text Processing - Volume 2

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper we propose a term clustering approach to improve the performance of sentence retrieval in Question Answering (QA) systems. As the search in question answering is conducted over smaller segments of data than in a document retrieval task, the problems of data sparsity and exact matching become more critical. In this paper we propose Language Modeling (LM) techniques to overcome such problems and improve the sentence retrieval performance. Our proposed methods include building class-based models by term clustering, and then employing higher order n-grams with the new class-based model. We report our experiments on the TREC 2007 questions from QA track. The results show that the methods investigated here enhanced the mean average precision of sentence retrieval from 23.62% to 29.91%.