Intra-assessor consistency in question answering

  • Authors:
  • Ian Ruthven;Leif Azzopardi Glasgow;Mark Baillie;Ralf Bierig;Emma Nicol;Simon Sweeney;Murat Yakici

  • Affiliations:
  • University of Strathclyde, Glasgow, United Kingdom;University of Glasgow, Glasgow, United Kingdom;University of Strathclyde, Glasgow, United Kingdom;University of Strathclyde, Glasgow, United Kingdom;University of Strathclyde, Glasgow, United Kingdom;University of Strathclyde, Glasgow, United Kingdom;University of Strathclyde, Glasgow, United Kingdom

  • Venue:
  • SIGIR '07 Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper we investigate the consistency of answer assessment in a complex question answering task examining features of assessor consistency, types of answers and question type.