The role of natural language in a multimodal interface
UIST '92 Proceedings of the 5th annual ACM symposium on User interface software and technology
HCI and the inadequacies of direct manipulation systems
ACM SIGCHI Bulletin
Integrality and separability of input devices
ACM Transactions on Computer-Human Interaction (TOCHI)
The role of voice in human-machine communication
Voice communication between humans and machines
Multimodal interfaces for dynamic interactive maps
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Sparks of Innovation in Human-Computer Interaction
Sparks of Innovation in Human-Computer Interaction
Speech-Enabled Augmented Reality Supporting Mobile Industrial Maintenance
IEEE Pervasive Computing
UbiComp '02 Proceedings of the 4th international conference on Ubiquitous Computing
Screen space: depiction and the space of interactive media
Proceedings of the sixth Eurographics workshop on Multimedia 2001
Screen space: depiction and the space of interactive media
Proceedings of the sixth Eurographics workshop on Multimedia 2001
Modular Approach of Multimodal Integration in a Virtual Environment
ICMI '02 Proceedings of the 4th IEEE International Conference on Multimodal Interfaces
Experimental evaluation of vision and speech based multimodal interfaces
Proceedings of the 2001 workshop on Perceptive user interfaces
Using a vibro-tactile display for enhanced collision perception and presence
Proceedings of the ACM symposium on Virtual reality software and technology
Design and evaluation of a wind display for virtual reality
Proceedings of the ACM symposium on Virtual reality software and technology
The effect of input mode on inactivity and interaction times of multimodal systems
Proceedings of the 9th international conference on Multimodal interfaces
Tlk or txt? Using voice input for SMS composition
Personal and Ubiquitous Computing
Multimodal system evaluation using modality efficiency and synergy metrics
ICMI '08 Proceedings of the 10th international conference on Multimodal interfaces
Interaction techniques for the analysis of complex data on high-resolution displays
ICMI '08 Proceedings of the 10th international conference on Multimodal interfaces
Steps in Identifying Interaction Design Patterns for Multimodal Systems
HCSE-TAMODIA '08 Proceedings of the 2nd Conference on Human-Centered Software Engineering and 7th International Workshop on Task Models and Diagrams
Modeling Aspects of Multimodal Lithuanian Human - Machine Interface
Multimodal Signals: Cognitive and Algorithmic Issues
International Journal of Business Information Systems
Using Graphical Representations to Improve the Usability of Email Clients
Proceedings of the 2008 conference on Knowledge-Based Software Engineering: Proceedings of the Eighth Joint Conference on Knowledge-Based Software Engineering
Fusion and fission: improved MMIA for multi-modal HCI based on WPS and voice-XML
ICOST'07 Proceedings of the 5th international conference on Smart homes and health telematics
The long-term adoption of speech recognition in medical applications
CBMS'03 Proceedings of the 16th IEEE conference on Computer-based medical systems
A pattern-based methodology for multimodal interaction design
TSD'06 Proceedings of the 9th international conference on Text, Speech and Dialogue
Hi-index | 0.00 |
A framework of complementary behavior has been proposed which maintains that direct-manipulation and speech interfaces have reciprocal strengths and weaknesses. This suggests that user interface performance and acceptance may increase by adopting a multimodal approach that combines speech and direct manipulation. This effort examined the hypothesis that the speed, accuracy, and acceptance of multimodal speech and direct-manipulation interfaces will increase when the modalities match the perceptual structure of the input attributes. A software prototype that supported a typical biomedical data collection task was developed to test this hypothesis. A group of 20 clinical and veterinary pathologists evaluated the prototype in an experimental setting using repeated measures. The results of this experiment supported the hypothesis that the perceptual structure of an input task is an important consideration when designing a multimodal computer interface. Task completion time, the number of speech errors, and user acceptance improved when interface best matched the perceptual structure of the input attributes.