Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations
The design space of input devices
Multimedia interface design
Integrating simultaneous input from speech, gaze, and hand gestures
Intelligent multimedia interfaces
Programming the multimodal interface
MULTIMEDIA '93 Proceedings of the first ACM international conference on Multimedia
A design space for multimodal systems: concurrent processing and data fusion
CHI '93 Proceedings of the INTERACT '93 and CHI '93 Conference on Human Factors in Computing Systems
A generic platform for addressing the multimodal challenge
CHI '95 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Multi-modal HCI: combination of gesture and speech recognition
CHI '93 INTERACT '93 and CHI '93 Conference Companion on Human Factors in Computing Systems
Generations of User-Interface Management Systems
IEEE Software
“Put-that-there”: Voice and gesture at the graphics interface
SIGGRAPH '80 Proceedings of the 7th annual conference on Computer graphics and interactive techniques
Towards high-level distributed multi-interface computing
Towards high-level distributed multi-interface computing
IEEE MultiMedia
Modular Approach of Multimodal Integration in a Virtual Environment
ICMI '02 Proceedings of the 4th IEEE International Conference on Multimodal Interfaces
Universal accessibility as a multimodal design issue
Communications of the ACM - ACM at sixty: a look back in time
Fuzzy Posture Input for Virtual-Hand Models
Presence: Teleoperators and Virtual Environments
Multimodal human-computer interaction: A survey
Computer Vision and Image Understanding
Multimodal Interaction: Real Context Studies on Mobile Digital Artefacts
HAID '08 Proceedings of the 3rd international workshop on Haptic and Audio Interaction Design
Proceedings of the Working Conference on Advanced Visual Interfaces
Multimodal interfaces: Challenges and perspectives
Journal of Ambient Intelligence and Smart Environments
Toward optimization of multimodal user interfaces for tactical audio applications
ERCIM'02 Proceedings of the User interfaces for all 7th international conference on Universal access: theoretical perspectives, practice, and experience
Toward sound-assisted intrusion detection systems
OTM'07 Proceedings of the 2007 OTM confederated international conference on On the move to meaningful internet systems: CoopIS, DOA, ODBASE, GADA, and IS - Volume Part II
Multimodal interfaces: Challenges and perspectives
Journal of Ambient Intelligence and Smart Environments
| Hi-index | 0.00 |
Recent advances in multimedia systems, and research into so-called virtual realities and immersive environments for data visualization, hint that it might not be long before our repertoire of standard interaction techniques expands beyond the textual and visual domains to include touch, gestures, voice, and 3D sound. Although much progress has been made in the use of single modalities for human-computer communication, the general problem of designing integrated multimodal systems is not well understood. This article surveys recent research in this area in order to gain an appreciation of the issues and of the diverse approaches proposed or implemented, with particular emphasis on work whose goal is to provide a generic platform to support multimodal interaction. Relevant terminology is also defined and clarified, and several taxonomies for modalities are reviewed. Readers may contact Blattner at the University of California, Davis, Hertz Hall, PO Box 808, L-794, Liermore, CA 94551, e-mail blattner@llnl.gov. Contact Glinert at Rensselaer Polytechnic Institute, Dept. of Computer Science, Amos Eaton Hall, Troy, NY 12180, e-mail glinert@cs.rpi.edu.