Experience with the evaluation of natural language question answerers

  • Authors:
  • Harry Tennant

  • Affiliations:
  • Coordinated Science Laboratory, University of Illinois at Urbana-Champaign, Urbana, IL

  • Venue:
  • IJCAI'79 Proceedings of the 6th international joint conference on Artificial intelligence - Volume 2
  • Year:
  • 1979

Quantified Score

Hi-index 0.00

Visualization

Abstract

Research in natural language processing could be facilitated by thorough and critical evaluations of natural language systems. Two measurements, conceptual and linguistic completeness, are defined and discussed in this paper. Testing done on two natural language question answerers demonstrated that the conceptual coverage of such systems should be extended to better satisfy the needs and expectations of users.