User and discourse models for multimodal communication
Intelligent user interfaces
A design space for multimodal systems: concurrent processing and data fusion
INTERCHI '93 Proceedings of the INTERCHI '93 conference on Human factors in computing systems
A perceptually-supported sketch editor
UIST '94 Proceedings of the 7th annual ACM symposium on User interface software and technology
Interactive sketching for the early stages of user interface design
CHI '95 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Interactive beautification: a technique for rapid geometric design
Proceedings of the 10th annual ACM symposium on User interface software and technology
Mutual disambiguation of recognition errors in a multimodel architecture
Proceedings of the SIGCHI conference on Human Factors in Computing Systems
Teddy: a sketching interface for 3D freeform design
Proceedings of the 26th annual conference on Computer graphics and interactive techniques
Multimodal system processing in mobile environments
UIST '00 Proceedings of the 13th annual ACM symposium on User interface software and technology
A suggestive interface for 3D drawing
Proceedings of the 14th annual ACM symposium on User interface software and technology
EGVE '02 Proceedings of the workshop on Virtual environments 2002
Graphical input through machine recognition of sketches
SIGGRAPH '76 Proceedings of the 3rd annual conference on Computer graphics and interactive techniques
Proceedings of the 15th annual ACM symposium on User interface software and technology
“Put-that-there”: Voice and gesture at the graphics interface
SIGGRAPH '80 Proceedings of the 7th annual conference on Computer graphics and interactive techniques
Pattern recognition and beautification for a pen based interface
ICDAR '95 Proceedings of the Third International Conference on Document Analysis and Recognition (Volume 1) - Volume 1
3D modeling of trees from freehand sketches
ACM SIGGRAPH 2003 Sketches & Applications
Deixis and conjunction in multimodal systems
COLING '00 Proceedings of the 18th conference on Computational linguistics - Volume 1
Finite-state multimodal parsing and understanding
COLING '00 Proceedings of the 18th conference on Computational linguistics - Volume 1
ICASSP '96 Proceedings of the Acoustics, Speech, and Signal Processing, 1996. on Conference Proceedings., 1996 IEEE International Conference - Volume 06
Fusion of children's speech and 2D gestures when conversing with 3D characters
Signal Processing - Special section: Multimodal human-computer interfaces
Steps in Identifying Interaction Design Patterns for Multimodal Systems
HCSE-TAMODIA '08 Proceedings of the 2nd Conference on Human-Centered Software Engineering and 7th International Workshop on Task Models and Diagrams
Fusion engines for multimodal input: a survey
Proceedings of the 2009 international conference on Multimodal interfaces
PixelTone: a multimodal interface for image editing
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
| Hi-index | 0.00 |
Users must enter a complex mix of spatial and abstract information when operating a graphic design application. Speech / language provides a fluid and natural method for specifying abstract information while a spatial input device is often most intuitive for the entry of spatial information. Thus, the combined speech / gesture interface is ideally suited to this application domain. While some research has been conducted on multimodal graphic design applications, advanced research on modality fusion has typically focused on map related applications. This paper considers the particular demands of graphic design applications and what impact these demands will have on the general strategies employed when combining the speech and gesture channels. We also describe initial work on our own multimodal graphic design application (DPD) which uses these strategies.