Virtual reality systems
Multimodal interfaces for dynamic interactive maps
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Pick-and-drop: a direct manipulation technique for multiple computer environments
Proceedings of the 10th annual ACM symposium on User interface software and technology
QuickSet: multimodal interaction for distributed applications
MULTIMEDIA '97 Proceedings of the fifth ACM international conference on Multimedia
Design principles for intelligent environments
AAAI '98/IAAI '98 Proceedings of the fifteenth national/tenth conference on Artificial intelligence/Innovative applications of artificial intelligence
VRPN: a device-independent, network-transparent VR peripheral system
VRST '01 Proceedings of the ACM symposium on Virtual reality software and technology
The Adaptive Agent Architecture: Achieving Fault-Tolerance Using Persistent Broker Teams
ICMAS '00 Proceedings of the Fourth International Conference on MultiAgent Systems (ICMAS-2000)
A visual modality for the augmentation of paper
Proceedings of the 2001 workshop on Perceptive user interfaces
Unification-based multimodal parsing
COLING '98 Proceedings of the 17th international conference on Computational linguistics - Volume 1
The KidsRoom: A Perceptually-Based Interactive and Immersive Story Environment
Presence: Teleoperators and Virtual Environments
Untethered gesture acquisition and recognition for a multimodal conversational system
Proceedings of the 5th international conference on Multimodal interfaces
Proceedings of the 6th international conference on Multimodal interfaces
Proceedings of the 6th international conference on Multimodal interfaces
Multimodal interaction for pedestrians: an evaluation study
Proceedings of the 10th international conference on Intelligent user interfaces
Using a vibro-tactile display for enhanced collision perception and presence
Proceedings of the ACM symposium on Virtual reality software and technology
Design and evaluation of a wind display for virtual reality
Proceedings of the ACM symposium on Virtual reality software and technology
Inferring body pose using speech content
ICMI '05 Proceedings of the 7th international conference on Multimodal interfaces
A study of manual gesture-based selection for the PEMMI multimodal transport management interface
ICMI '05 Proceedings of the 7th international conference on Multimodal interfaces
Gameplay issues in the design of spatial 3D gestures for video games.
CHI '06 Extended Abstracts on Human Factors in Computing Systems
Supporting Community Emergency Management Planning through a Geocollaboration Software Architecture
Computer Supported Cooperative Work
Interpreting pointing gestures and spoken requests: a probabilistic, salience-based approach
COLING '10 Proceedings of the 23rd International Conference on Computational Linguistics: Posters
Enabling the mobile web through auto-generating multimodal web pages
CIMMACS'05 Proceedings of the 4th WSEAS international conference on Computational intelligence, man-machine systems and cybernetics
Mobility in environmental planning: an integrated multi-agent approach
CDVE'05 Proceedings of the Second international conference on Cooperative Design, Visualization, and Engineering
| Hi-index | 0.00 |
We describe an augmentation of Quickset, a multimodal voice/pen system that allows users to create and control map-based, collaborative, interactive simulations. In this paper, we report on our extension of the graphical pen input mode from stylus/mouse to 3D hand movements. To do this, the map is projected onto a virtual plane in space, specified by the operator beforethe start of the interactive session. We then use our geometric model to compute the intersection of hand movements with the virtual plane, translating these into map coordinates on the appropriate system. The goal of this research is the creation of a body-centered, multimodal architecture employing both speech and 3D hand gestures, which seamlessly and unobtrusively supports distributed interaction. The augmented system, built on top of an existing architecture, also provides an improved visualization, management and awareness of a shared understanding. Potential applications of this work include tele-medicine, battlefield management and any kind of collaborative decision-making during which users may wish to be mobile.