Spatial ontology for semantic integration in 3D multimodal interaction framework
Proceedings of the 2006 ACM international conference on Virtual reality continuum and its applications
Introducing semantic information during conceptual modelling of interaction for virtual environments
Proceedings of the 2007 workshop on Multimodal interfaces in semantic interaction
Designing context-aware multimodal virtual environments
ICMI '08 Proceedings of the 10th international conference on Multimodal interfaces
Is the subjective feel of "presence" an uninteresting goal?
Journal of Visual Languages and Computing
| Hi-index | 0.00 |
We present a system for real-time configuration of multimodal interfaces to Virtual Environments (VE). The flexibility of our tool is supported by a semantics-based representation of VEs. Semantic descriptors are used todefine interaction devices and virtual entities under control. We use portable (XML) descriptors to define the I/O channels of a variety of interaction devices. Semantic description of virtual objects turns them into reactive entities with whom the user can communicate in multiple ways. This article gives details on the semantics-based representation and presents some examples of multimodal interfaces created with our system, including gestures-based and PDA-based interfaces, amongst others.