A Meme Media Framework for Introducing a Multimodal User Interface to Existing Web Applications

  • Authors:
  • Kimihito Ito

  • Affiliations:
  • Meme Media Laboratory, Hokkaido University, Sapporo 060-8628, Japan

  • Venue:
  • Proceedings of the 2006 conference on Information Modelling and Knowledge Bases XVII
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

Web applications, which are computer programs ported to the Web, allow us to use various remote services and tools through our Web browsers. There are an enormous number of Web applications on the Web, and they are becoming the basic infrastructure of everyday life. At the same time, multimodal character agents, which interact with human users by both verbal and nonverbal behavior, have recently seen remarkable development. It would be of great benefit if we could easily modify existing Web applications by adding multimodal user interface to them. This paper proposes a framework where IntelligentPad and Multimodal Presentation Markup Language work in collaboration to introduce multimodal character agentsto the front-end of existing Web applications. Example applications include attaching a multimodal user-interface to a news site on the Web. The framework does not require users to write any program code or script.