LDA based similarity modeling for question answering

  • Authors:
  • Asli Celikyilmaz;Dilek Hakkani-Tur;Gokhan Tur

  • Affiliations:
  • University of California, Berkeley;Science Institute, Berkeley, CA;SRI International, Menlo Park, CA

  • Venue:
  • SS '10 Proceedings of the NAACL HLT 2010 Workshop on Semantic Search
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

We present an exploration of generative modeling for the question answering (QA) task to rank candidate passages. We investigate Latent Dirichlet Allocation (LDA) models to obtain ranking scores based on a novel similarity measure between a natural language question posed by the user and a candidate passage. We construct two models each one introducing deeper evaluations on latent characteristics of passages together with given question. With the new representation of topical structures on QA datasets, using a limited amount of world knowledge, we show improvements on performance of a QA ranking system.