Multimodal user interfaces for a travel assistant

Authors:
Alain Goyé;Eric Lecolinet;Shiuan-Sung Lin;Gérard Chollet;Catherine Pelachaud;Xiaoqing Ding;Yang Ni
Affiliations:
ENST;ENST;ENST;ENST;Université de Paris VIII;Tsinghua University;Institut National des Télécommunications
Venue:
IHM 2003 Proceedings of the 15th French-speaking conference on human-computer interaction on 15eme Conference Francophone sur l'Interaction Homme-Machine
Year:
2003

Citing 7
Cited 0

The design and implementation of pie menus

Dr. Dobb's Journal
The Hotbox: efficient access to a large number of menu-items

Proceedings of the SIGCHI conference on Human Factors in Computing Systems
Context and interaction in zoomable user interfaces

AVI '00 Proceedings of the working conference on Advanced visual interfaces
Fluid interaction with high-resolution wall-size displays

Proceedings of the 14th annual ACM symposium on User interface software and technology
Embodied contextual agent in information delivering application

Proceedings of the first international joint conference on Autonomous agents and multiagent systems: part 2
Control menus: excecution and control in a single interactor

CHI '00 Extended Abstracts on Human Factors in Computing Systems
A PDA-Based Sign Translator

ICMI '02 Proceedings of the 4th IEEE International Conference on Multimodal Interfaces

Quantified Score

Hi-index	0.00

Visualization

Abstract

As a part of a project to develop a personal assistant for travellers, we have studied three types of multimodal interfaces for a PDA: 1) a combination of Control menus and vocal inputs to control zoomable user interfaces to graphical or textual databases, 2) refinement of pictures captured by the integrated camera, based on correlating a series of pictures, in order to enhance character recognition, and 3) embodied conversational agents able to communicate via synchronized speech and culturedependent nonverbal behaviors (face, gaze and gesture). We describe in this paper these three modalities and their integration in the main application.