Towards automatic question answering over social media by learning question equivalence patterns

  • Authors:
  • Tianyong Hao;Wenyin Liu;Eugene Agichtein

  • Affiliations:
  • City University of Hong Kong, Kowloon, Hong Kong, SAR;City University of Hong Kong, Kowloon, Hong Kong, SAR;Emory University, Atlanta, Georgia

  • Venue:
  • WSA '10 Proceedings of the NAACL HLT 2010 Workshop on Computational Linguistics in a World of Social Media
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

Many questions submitted to Collaborative Question Answering (CQA) sites have been answered before. We propose an approach to automatically generating an answer to such questions based on automatically learning to identify "equivalent" questions. Our main contribution is an unsupervised method for automatically learning question equivalence patterns from CQA archive data. These patterns can be used to match new questions to their equivalents that have been answered before, and thereby help suggest answers automatically. We experimented with our method approach over a large collection of more than 200,000 real questions drawn from the Yahoo! Answers archive, automatically acquiring over 300 groups of question equivalence patterns. These patterns allow our method to obtain over 66% precision on automatically suggesting answers to new questions, significantly outperforming conventional baseline approaches to question matching.