Improving QA accuracy by question inversion

  • Authors:
  • John Prager;Pablo Duboue;Jennifer Chu-Carroll

  • Affiliations:
  • IBM T.J. Watson Res. Ctr., Yorktown Heights, N.Y.;IBM T.J. Watson Res. Ctr., Yorktown Heights, N.Y.;IBM T.J. Watson Res. Ctr., Yorktown Heights, N.Y.

  • Venue:
  • ACL-44 Proceedings of the 21st International Conference on Computational Linguistics and the 44th annual meeting of the Association for Computational Linguistics
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper demonstrates a conceptually simple but effective method of increasing the accuracy of QA systems on factoid-style questions. We define the notion of an inverted question, and show that by requiring that the answers to the original and inverted questions be mutually consistent, incorrect answers get demoted in confidence and correct ones promoted. Additionally, we show that lack of validation can be used to assert no-answer (nil) conditions. We demonstrate increases of performance on TREC and other question-sets, and discuss the kinds of future activities that can be particularly beneficial to approaches such as ours.