Handling multimodal dialogues for exploratory data analysis using charts

  • Authors:
  • Tsuneaki Kato;Mitsunori Matsushita

  • Affiliations:
  • Language and Information Sciences, The University of Tokyo, Tokyo, 153-8902 Japan;NTT Communication Science Laboratories, NTT Corporation, Kyoto, 619-0237 Japan

  • Venue:
  • Systems and Computers in Japan
  • Year:
  • 2005

Quantified Score

Hi-index 0.00

Visualization

Abstract

A methodology is proposed for taking queries and requests expressed in natural language as input, and answering them in charts by organizing that interaction into appropriate dialogue. The objective of the research is to make it possible to interactively use charts and graphics, which, as well as languages, are important modes of communication, for analyzing huge amounts of data and for discovering its characteristics and tendencies. This paper shows that in such situations the correctness of the charts could be revealed by understanding the context, and proposes a framework to handle chart appropriateness through context processing. The core of the framework is a logical form that includes the specifications of users' perspectives and the proper treatment of the logical form for handling utterances and utterance fragments in contexts. The framework has been confirmed through an empirical study to be appropriate, and has been implemented. © 2005 Wiley Periodicals, Inc. Syst Comp Jpn, 36(8): 59–70, 2005; Published online in Wiley InterScience (). DOI 10.1002/scj.20298