WoZ simulation of interactive question answering

  • Authors:
  • Tsuneaki Kato;Fumito Masui;Jun'ichi Fukumoto;Noriko Kando

  • Affiliations:
  • The University of Tokyo;Mie University;Ritsumeikan University;National Institute of Informatics

  • Venue:
  • IQA '06 Proceedings of the Interactive Question Answering Workshop at HLT-NAACL 2006
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

QACIAD (Question Answering Challenge for Information Access Dialogue) is an evaluation framework for measuring interactive question answering (QA) technologies. It assumes that users interactively collect information using a QA system for writing a report on a given topic and evaluates, among other things, the capabilities needed under such circumstances. This paper reports an experiment for examining the assumptions made by QACIAD. In this experiment, dialogues under the situation that QACIAD assumes are collected using WoZ (Wizard of Oz) simulating, which is frequently used for collecting dialogue data for designing speech dialogue systems, and then analyzed. The results indicate that the setting of QACIAD is real and appropriate and that one of the important capabilities for future interactive QA systems is providing cooperative and helpful responses.