Communications of the ACM
Interactive sketching for the early stages of user interface design
CHI '95 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Pick-and-drop: a direct manipulation technique for multiple computer environments
Proceedings of the 10th annual ACM symposium on User interface software and technology
QuickSet: multimodal interaction for distributed applications
MULTIMEDIA '97 Proceedings of the fifth ACM international conference on Multimedia
DENIM: finding a tighter fit between tools and practice for Web site design
Proceedings of the SIGCHI conference on Human Factors in Computing Systems
Suede: a Wizard of Oz prototyping tool for speech user interfaces
UIST '00 Proceedings of the 13th annual ACM symposium on User interface software and technology
DEMAIS: designing multimedia applications with interactive storyboards
MULTIMEDIA '01 Proceedings of the ninth ACM international conference on Multimedia
Where do web sites come from?: capturing and interacting with design history
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Embarking on Multimodal Interface Design
ICMI '02 Proceedings of the 4th IEEE International Conference on Multimodal Interfaces
Visually prototyping perceptual user interfaces through multimodal storyboarding
Proceedings of the 2001 workshop on Perceptive user interfaces
Prototypes in the Wild: Lessons from Three Ubicomp Systems
IEEE Pervasive Computing
SketchWizard: Wizard of Oz prototyping of pen-based user interfaces
Proceedings of the 20th annual ACM symposium on User interface software and technology
Natural multimodal dialogue systems: a configurable dialogue and presentation strategies component
Proceedings of the 9th international conference on Multimodal interfaces
Adapting paper prototyping for designing user interfaces for multiple display environments
Personal and Ubiquitous Computing - Special Issue: User-centred design and evaluation of ubiquitous groupware
ICMI '08 Proceedings of the 10th international conference on Multimodal interfaces
Proceedings of the 1st ACM SIGCHI symposium on Engineering interactive computing systems
Component-based high fidelity interactive prototyping of post-WIMP interactions
International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction
Interactive prototyping of tabletop and surface applications
Proceedings of the 5th ACM SIGCHI symposium on Engineering interactive computing systems
Electronic sketching on a multi-platform context: A pilot study with developers
International Journal of Human-Computer Studies
Hi-index | 0.00 |
Interaction designers are increasingly faced with the challenge of creating interfaces that incorporate multiple input modalities, such as pen and speech, and span multiple devices. Few early stage prototyping tools allow non-programmers to prototype these interfaces. Here we describe CrossWeaver, a tool for informally prototyping multimodal, multidevice user interfaces. This tool embodies the informal prototyping paradigm, leaving design representations in an informal, sketched form, and creates a working prototype from these sketches. CrossWeaver allows a user interface designer to sketch storyboard scenes on the computer, specifying simple multimodal command transitions between scenes. The tool also allows scenes to target different output devices. Prototypes can run across multiple standalone devices simultaneously, processing multimodal input from each one. Thus, a designer can visually create a multimodal prototype for a collaborative meeting or classroom application. CrossWeaver captures all of the user interaction when running a test of a prototype. This input log can quickly be viewed visually for the details of the users' multimodal interaction or it can be replayed across all participating devices, giving the designer information to help him or her analyze and iterate on the interface design.