Semantic pattern-based user interactive question answering: user interface design and evaluation

Authors:
Tianyong Hao;Wenyin Liu;Chunshen Zhu
Affiliations:
Department of Chinese, Translation and Linguistics, City University of Hong Kong, Hong Kong;Department of Computer Science, City University of Hong Kong, Hong Kong;Department of Chinese, Translation and Linguistics, City University of Hong Kong, Hong Kong
Venue:
ICIC'11 Proceedings of the 7th international conference on Advanced Intelligent Computing Theories and Applications: with aspects of artificial intelligence
Year:
2011

Citing 8
Cited 0

Automated Question Answering Using Question Templates That Cover the Conceptual Model of the Database

NLDB '02 Proceedings of the 6th International Conference on Applications of Natural Language to Information Systems-Revised Papers
Web question answering through automatically learned patterns

Proceedings of the 4th ACM/IEEE-CS joint conference on Digital libraries
Learning surface text patterns for a Question Answering system

ACL '02 Proceedings of the 40th Annual Meeting on Association for Computational Linguistics
Question answering based on semantic structures

COLING '04 Proceedings of the 20th international conference on Computational Linguistics
Semantic patterns for user-interactive question answering

Concurrency and Computation: Practice & Experience - Second International Conference on Semantics, Knowledge and Grid (SKG2006)
Knowledge sharing and yahoo answers: everyone knows something

Proceedings of the 17th international conference on World Wide Web
Semantic pattern learning through maximum entropy-based WSD technique

ConLL '01 Proceedings of the 2001 workshop on Computational Natural Language Learning - Volume 7
A Web-Based Platform for User-Interactive Question-Answering

World Wide Web

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper presents two user interfaces for a pattern-based User Interactive Question Answering system, which are designed to encourage users to ask questions by using semantic patterns. One is a Guide-Based User Interface (GBUI), which can guide users with clear instructions. However, it involves many steps and the operation may become tedious. The other is a Recommendation-Based User Interface (RBUI), which recommends a few relevant patterns containing automatically suggested details for each free-text question. However, the recommended patterns may not always be satisfactory and sometimes the user's revision is needed. In comparing these two user interfaces, we propose a new Complexity Evaluation Model (CEM) to evaluate the complexity on the basis of user log study and a realistic focused user study. The results of the study user logs, which cover a test set of 1605 users and 488 semantic patterns, show that RBUI can improve the complexity of GBUI by 39.8% on average. The improvement is also confirmed by the user study. It has thus become clear that RBUI can improve the usability of the UIQA system in terms of helping the system accumulate high quality pattern-based questions.