TRAINS-96 System Evaluation

  • Authors:
  • Amanda J. Stent;James F. Allen

  • Affiliations:
  • -;-

  • Venue:
  • TRAINS-96 System Evaluation
  • Year:
  • 1997

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this report we describe an experiment designed to: evaluate the performance of the TRAINS-96 system as a whole; examine the utility of a new robust post-parser module, recently added to the TRAINS system; and explore the benefit to the user of receiving system feedback on speech input. The evaluation uses the same task-based methodology as was used for the TRAINS-95 evaluation [Sikorski and Allen 96], in which the user and computer cooperatively solve a given problem. Success is measured in terms of task performance measures such as time to completion of a task, and the quality of the final plan produced.