Is it correct?: towards web-based evaluation of automatic natural language phrase generation

Authors:
Calkin S. Montero;Kenji Araki
Affiliations:
Hokkaido University, Kita-ku, Sapporo, Japan;Hokkaido University, Kita-ku, Sapporo, Japan
Venue:
COLING-ACL '06 Proceedings of the COLING/ACL on Interactive presentation sessions
Year:
2006

Citing 5
Cited 1

ELIZA—a computer program for the study of natural language communication between man and machine

Communications of the ACM
Scaling question answering to the web

ACM Transactions on Information Systems (TOIS)
The Web as a parallel corpus

Computational Linguistics - Special issue on web as corpus
The indexable web is more than 11.5 billion pages

WWW '05 Special interest tracks and posters of the 14th international conference on World Wide Web
Searching for common sense: populating Cyc™ from the web

AAAI'05 Proceedings of the 20th national conference on Artificial intelligence - Volume 3

Evaluation of Trivial Dialogue Phrase Databases Through Practical Application to User-Computer Conversation - Case Study: English - Spanish

KES '07 Knowledge-Based Intelligent Information and Engineering Systems and the XVII Italian Workshop on Neural Networks on Proceedings of the 11th International Conference

Quantified Score

Hi-index	0.01

Visualization

Abstract

This paper describes a novel approach for the automatic generation and evaluation of a trivial dialogue phrases database. A trivial dialogue phrase is defined as an expression used by a chatbot program as the answer of a user input. A transfer-like genetic algorithm (GA) method is used to generating the trivial dialogue phrases for the creation of a natural language generation (NLG) knowledge base. The automatic evaluation of a generated phrase is performed by producing n-grams and retrieving their frequencies from the World Wide Web (WWW). Preliminary experiments show very positive results.