Specifying gestures by example
Proceedings of the 18th annual conference on Computer graphics and interactive techniques
Preserving knowledge in design projects: what designers need to know
CHI '93 Proceedings of the INTERACT '93 and CHI '93 Conference on Human Factors in Computing Systems
Stimulating ideas through creativity software
Management Science
Interactive sketching for the early stages of user interface design
CHI '95 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
SpeechSkimmer: a system for interactively skimming recorded speech
ACM Transactions on Computer-Human Interaction (TOCHI) - Special issue on speech as data
SILK: sketching interfaces like krazy
Conference Companion on Human Factors in Computing Systems
The Amulet Environment: New Models for Effective User Interface Software Development
IEEE Transactions on Software Engineering
Jotmail: a voicemail interface that enables you to see what was said
Proceedings of the SIGCHI conference on Human Factors in Computing Systems
A visual language for sketching large and complex interactive designs
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Moving markup: repositioning freeform annotations
Proceedings of the 15th annual ACM symposium on User interface software and technology
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
The "Authoring on the Fly" system for automated recording and replay of (tele)presentations
Multimedia Systems - Special issue: Multimedia authoring and presentation techniques
The audio notebook: paper and pen interaction with structured speech
The audio notebook: paper and pen interaction with structured speech
INTERACTING with sketched interface designs: an evaluation study
CHI '04 Extended Abstracts on Human Factors in Computing Systems
Integration and synchronization of input modes during multimodal human-computer interaction
ReferringPhenomena '97 Referring Phenomena in a Multimedia Context and their Computational Treatment
| Hi-index | 0.00 |
We present a tool for rapid UI design using sketch and speech recognition. Our tool is designed to support conversation between a user and a designer within one room. Participants of the conversation discuss the UI orally while sketching UI layouts, storyboards and diagrams. A TabletPC is used to record and recognize both the speech and sketches created during discussion. The recognition is used for beautification of the sketches. The recording allows fast skimming through the results of the entire UI design session, freeing the designer from the tedious task of taking detailed notes.