Embarking on Multimodal Interface Design

Authors:
Anoop K. Sinha;James A. Landay
Affiliations:
University of California at Berkeley;University of California at Berkeley
Venue:
ICMI '02 Proceedings of the 4th IEEE International Conference on Multimodal Interfaces
Year:
2002

Citing 6
Cited 1

Wizard of Oz studies: why and how

IUI '93 Proceedings of the 1st international conference on Intelligent user interfaces
Prototyping for tiny fingers

Communications of the ACM
NEIMO, a multiworkstation usability lab for observing and analyzing multimodal interaction

Conference Companion on Human Factors in Computing Systems
Multimodal theater: extending low fidelity paper prototyping to multimodal applications

CHI '02 Extended Abstracts on Human Factors in Computing Systems
“Put-that-there”: Voice and gesture at the graphics interface

SIGGRAPH '80 Proceedings of the 7th annual conference on Computer graphics and interactive techniques
Designing the user interface for multimodal speech and pen-based gesture applications: state-of-the-art systems and future research directions

Human-Computer Interaction

Capturing user tests in a multimodal, multidevice informal prototyping tool

Proceedings of the 5th international conference on Multimodal interfaces

Quantified Score

Hi-index	0.00

Visualization

Abstract

Designers are increasingly faced with the challenge of targeting multimodal applications, those that span heterogeneous devices and use multimodal input, but do not have tools to support them. We studied the early stage work practices of professional multimodal interaction designers. We noted the variety of different artifacts produced, such as design sketches and paper prototypes. Additionally, we observed Wizard of Oz techniques that are sometimes used to simulate an interactive application from these sketches. These studies have led to our development of a technique for interface designers to consider as they embark on creating multimodal applications.