Performance measures for the next generation of spoken natural language dialog systems

  • Authors:
  • Ronnie W. Smith

  • Affiliations:
  • East Carolina University, Greenville, NC

  • Venue:
  • ISDS '97 Interactive Spoken Dialog Systems on Bringing Speech and NLP Together in Real Applications
  • Year:
  • 1997

Quantified Score

Hi-index 0.00

Visualization

Abstract

Since approximately the mid 1980's, technology has been adequate (if not ideal) for researchers to construct spoken natural language dialog systems (SNLDS) in order to test theories of natural language processing and to see what machines were capable of based on current technological limits. Over the course of time, a few systems have been constructed in sufficient detail and robustness to enable some evaluation of the systems. For the most part, these systems were greatly limited by the available speech recognition technology. Continuous speech systems required speaker dependent training and restricted vocabularies, but still had such a large number of misrecognitions that this tended to be the limiting factor in the success of the system. For example, testing in 1991 of the Circuit Fix-It Shop of (Smith, Hipp, and Biermann, 1995) required an experimenter to remain in the room in order to notify the user when misrecognitions occurred.