Evaluation of a layered approach to question answering over linked data

  • Authors:
  • Sebastian Walter;Christina Unger;Philipp Cimiano;Daniel Bär

  • Affiliations:
  • CITEC, Bielefeld University, Germany;CITEC, Bielefeld University, Germany;CITEC, Bielefeld University, Germany;Ubiquitous Knowledge Processing Lab (UKP-TUDA), Department of Computer Science, Technische Universität, Darmstadt, Germany

  • Venue:
  • ISWC'12 Proceedings of the 11th international conference on The Semantic Web - Volume Part II
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

We present a question answering system architecture which processes natural language questions in a pipeline consisting of five steps: i) question parsing and query template generation, ii) lookup in an inverted index, iii) string similarity computation, iv) lookup in a lexical database in order to find synonyms, and v) semantic similarity computation. These steps are ordered with respect to their computational effort, following the idea of layered processing: questions are passed on along the pipeline only if they cannot be answered on the basis of earlier processing steps, thereby invoking computationally expensive operations only for complex queries that require them. In this paper we present an evaluation of the system on the dataset provided by the 2nd Open Challenge on Question Answering over Linked Data (QALD-2). The main, novel contribution is a systematic empirical investigation of the impact of the single processing components on the overall performance of question answering over linked data.