An experiment into the use of auditory cues to reduce visual workload
CHI '89 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Multidimensional audio window management
International Journal of Man-Machine Studies - Computer-supported cooperative work and groupware. part 2
Throwing, pitching and catching sound: audio windowing models and modes
International Journal of Man-Machine Studies
QuickSet: multimodal interaction for distributed applications
MULTIMEDIA '97 Proceedings of the fifth ACM international conference on Multimedia
Human-computer interaction (2nd ed.)
Human-computer interaction (2nd ed.)
Putting the feel in ’look and feel‘
Proceedings of the SIGCHI conference on Human Factors in Computing Systems
Taming recognition errors with a multimodal interface
Communications of the ACM
“Put-that-there”: Voice and gesture at the graphics interface
SIGGRAPH '80 Proceedings of the 7th annual conference on Computer graphics and interactive techniques
ITCC '02 Proceedings of the International Conference on Information Technology: Coding and Computing
The rising pitch metaphor: an empirical study
International Journal of Human-Computer Studies
The design and evaluation of a sonically enhanced tool palette
ACM Transactions on Applied Perception (TAP)
VoiceCode: an innovative speech interface for programming-by-voice
CHI '06 Extended Abstracts on Human Factors in Computing Systems
Enhancing usability of UML CASE-tools with speech recognition
HCC '03 Proceedings of the 2003 IEEE Symposium on Human Centric Computing Languages and Environments
An Assessment of a Speech-Based Programming Environment
VLHCC '06 Proceedings of the Visual Languages and Human-Centric Computing
A speech recognition and synthesis tool
Proceedings of the 44th annual Southeast regional conference
Speech and sketching for multimodal design
ACM SIGGRAPH 2006 Courses
Fine-Tuning the Human-Computer Interface: Verbal versus Keyboard Input in an Idea Generation Context
HICSS '07 Proceedings of the 40th Annual Hawaii International Conference on System Sciences
Automation of VUIto GUI mapping
CHI '13 Extended Abstracts on Human Factors in Computing Systems
| Hi-index | 0.00 |
Previous studies on usability of crowded graphical interfaces that are full of widgets like menus, buttons, palette-tools etc, have shown evidence that they create a fertile environment for information overload and usability problems. In this paper, we investigate the use of multimodal interaction metaphors (visual, vocal and aural) for improving effectiveness of learning functions and completing tasks in one of the most graphically crowded user-interfaces, the user-interface of IDEs (or Interface Design Environments). This investigation was done empirically on two experimental interface design toolkits (TVOID and MMID) which were built especially for the study. Assessment of the visual and multimodal interaction metaphors was carried out by two independent groups of users (A and B) of which each consisted of 15 users. Results showed that the use of speech for input and output along with limited use of the mouse was more effective than interacting visually only using the typical common graphical metaphors: pull-down menus, toolbar, toolbox, properties-table and status-bar.