Visually prototyping perceptual user interfaces through multimodal storyboarding

Authors:
Anoop K. Sinha;James A. Landay
Affiliations:
University of California, Berkeley, Berkeley, CA;University of California, Berkeley, Berkeley, CA
Venue:
Proceedings of the 2001 workshop on Perceptive user interfaces
Year:
2001

Citing 7
Cited 5

A design space for multimodal systems: concurrent processing and data fusion

INTERCHI '93 Proceedings of the INTERCHI '93 conference on Human factors in computing systems
Watch what I do: programming by demonstration

Watch what I do: programming by demonstration
QuickSet: multimodal interaction for distributed applications

MULTIMEDIA '97 Proceedings of the fifth ACM international conference on Multimedia
Mutual disambiguation of recognition errors in a multimodel architecture

Proceedings of the SIGCHI conference on Human Factors in Computing Systems
DENIM: finding a tighter fit between tools and practice for Web site design

Proceedings of the SIGCHI conference on Human Factors in Computing Systems
SATIN: a toolkit for informal ink-based applications

UIST '00 Proceedings of the 13th annual ACM symposium on User interface software and technology
Sketching Interfaces: Toward More Human Interface Design

Computer

Capturing user tests in a multimodal, multidevice informal prototyping tool

Proceedings of the 5th international conference on Multimodal interfaces
Wizard of Oz prototyping of computer vision based action games for children

Proceedings of the 2004 conference on Interaction design and children: building a community
Designing and evaluating multimodal interaction for mobile contexts

ICMI '08 Proceedings of the 10th international conference on Multimodal interfaces
A computer vision and hearing based user interface for a computer game for children

ERCIM'02 Proceedings of the User interfaces for all 7th international conference on Universal access: theoretical perspectives, practice, and experience
Do predictions of visual perception aid design?

ACM Transactions on Applied Perception (TAP)

Quantified Score

Hi-index	0.00

Visualization

Abstract

We are applying our knowledge in designing informal prototyping tools for user interface design to create an interactive visual prototyping tool for perceptual user interfaces. Our tool allows a designer to quickly map out certain types of multimodal, cross-device user interface scenarios. These sketched designs form a multimodal storyboard that can then be executed, quickly testing the interaction and collecting feedback about refinements necessary for the design. By relying on visual prototyping, our multimodal storyboarding tool simplifies and speeds perceptual user interface prototyping and opens up the challenging space of perceptual user interface design to non-programmers.