BYBLOS speech recognition benchmark results
HLT '91 Proceedings of the workshop on Speech and Natural Language
Evaluation of the CMU ATIS system
HLT '91 Proceedings of the workshop on Speech and Natural Language
Degrees of acyclicity for hypergraphs and relational database schemes
Journal of the ACM (JACM)
Preliminary ATIS development at MIT
HLT '90 Proceedings of the workshop on Speech and Natural Language
CICLing'03 Proceedings of the 4th international conference on Computational linguistics and intelligent text processing
A domain independent natural language interface to databases capable of processing complex queries
MICAI'05 Proceedings of the 4th Mexican international conference on Advances in Artificial Intelligence
Mapping Natural Language into SQL in a NLIDB
NLDB '08 Proceedings of the 13th international conference on Natural Language and Information Systems: Applications of Natural Language to Information Systems
Dialogue manager for a NLIDB for solving the semantic ellipsis problem in query formulation
KES'10 Proceedings of the 14th international conference on Knowledge-based and intelligent information and engineering systems: Part II
| Hi-index | 0.00 |
This paper deals with a domain-independent natural language interface to databases (NLIDB) for the Spanish language. This NLIDB had been previously tested for the Northwind and Pubs domains and had attained good performance (86% success rate). However, domain independence complicates the task of achieving high translation success, and to this end the ATIS (Air Travel Information System) database, which has been used by several natural language interfaces, was selected to conduct a new evaluation. The purpose of this evaluation was to asses the efficiency of the interface after the reconfiguration for another domain and to detect the problems that affect translation success. For the tests a corpus of queries was gathered and the results obtained showed that the interface can easily be reconfigured and that attained a 50% success rate. When the found problems concerning query translation were analyzed, wording deficiencies of some user queries and several errors in the synonym dictionary were discovered. After correcting these problems a second test was conducted, in which the interface attained a 61.4% success rate. These experiments showed that user training is necessary as well as a dialogue system that permits to clarify a query when it is deficiently formulated.