Multimodal Interaction for 2D and 3D Environments

Authors:
Philip Cohen;David McGee;Sharon Oviatt;Lizhong Wu;Joshua Clow;Robert King;Simon Julier;Lawrence Rosenblum
Affiliations:
-;-;-;-;-;-;-;-
Venue:
IEEE Computer Graphics and Applications
Year:
1999

Citing 0
Cited 18

A framework to manage multimodal fusion of events for advanced interactions within virtual environments

EGVE '02 Proceedings of the workshop on Virtual environments 2002
Speech and gesture multimodal control of a whole Earth 3D visualization environment

VISSYM '02 Proceedings of the symposium on Data Visualisation 2002
Boom chameleon: simultaneous capture of 3D viewpoint, voice and gesture annotations on a spatially-aware display

Proceedings of the 15th annual ACM symposium on User interface software and technology
Evaluation of a multimodal interface for 3D terrain visualization

Proceedings of the conference on Visualization '02
Graph Voronoi Regions for Interfacing Planar Graphs

ICCS '01 Proceedings of the International Conference on Computational Sciences-Part I
Advances in the robust processing of multimodal speech and pen systems

Multimodal interface for human-machine communication
Modular Approach of Multimodal Integration in a Virtual Environment

ICMI '02 Proceedings of the 4th IEEE International Conference on Multimodal Interfaces
Mutual disambiguation of 3D multimodal interaction in augmented and virtual reality

Proceedings of the 5th international conference on Multimodal interfaces
The efficiency of multimodal interaction for a map-based task

ANLC '00 Proceedings of the sixth conference on Applied natural language processing
Combining environmental cues & head gestures to interact with wearable devices

ICMI '05 Proceedings of the 7th international conference on Multimodal interfaces
A user interface framework for multimodal VR interactions

ICMI '05 Proceedings of the 7th international conference on Multimodal interfaces
Designing the user interface for multimodal speech and pen-based gesture applications: state-of-the-art systems and future research directions

Human-Computer Interaction
Adding speech recognition support to UML tools

Journal of Visual Languages and Computing
VR-CAD integration: Multimodal immersive interaction and advanced haptic paradigms for implicit edition of CAD models

Computer-Aided Design
Software architecture for multimodal user input - FLUID

ERCIM'02 Proceedings of the User interfaces for all 7th international conference on Universal access: theoretical perspectives, practice, and experience
Human-centered visualization environments

Human-centered visualization environments
An evaluation of an augmented reality multimodal interface using speech and paddle gestures

ICAT'06 Proceedings of the 16th international conference on Advances in Artificial Reality and Tele-Existence
Expanding interaction potentials within virtual environments: investigating the usability of speech and manual input modes for decoupled interaction

Advances in Human-Computer Interaction

Quantified Score

Hi-index	0.00

Visualization

Abstract

The allure of immersive technologies is undeniable. Unfortunately, the user's ability to interact with these environments lags behind the impressive visuals. In particular, it's difficult to navigate in unknown visual landscapes, find entities, access information and select entities using six-degrees-of-freedom (6-DOF) devices. We believe multimodal interaction-specifically speech and gesture-will make a major difference in the usability of such environments