A gesture processing framework for multimodal interaction in virtual reality
AFRIGRAPH '01 Proceedings of the 1st international conference on Computer graphics, virtual reality and visualisation
Modeling Methods for Reusable and Interoperable Virtual Entities in Multimedia Virtual Worlds
Multimedia Tools and Applications
Using Semantic Networks for Knowledge Representation in an Intelligent Environment
PERCOM '03 Proceedings of the First IEEE International Conference on Pervasive Computing and Communications
Avocado: A Distributed Virtual Reality Framework
VR '99 Proceedings of the IEEE Virtual Reality
Designing Transition Networks for Multimodal VR-Interactions Using a Markup Language
ICMI '02 Proceedings of the 4th IEEE International Conference on Multimodal Interfaces
Resolving Object References in Multimodal Dialogues for Immersive Virtual Environments
VR '04 Proceedings of the IEEE Virtual Reality 2004
Making sense of virtual environments: action representation, grounding and common sense
Proceedings of the 12th international conference on Intelligent user interfaces
Semantic Information and Local Constraints for Parametric Parts in Interactive Virtual Construction
SG '07 Proceedings of the 8th international symposium on Smart Graphics
A Phong-based concept for 3d-audio generation
SG'11 Proceedings of the 11th international conference on Smart graphics
Get involved in an interactive virtual tour of brest harbour: follow the guide and participate
IVA'11 Proceedings of the 10th international conference on Intelligent virtual agents
A semantic generation framework for enabling adaptive game worlds
Proceedings of the 8th International Conference on Advances in Computer Entertainment Technology
Evaluating affective feedback of the 3d agent max in a competitive cards game
ACII'05 Proceedings of the First international conference on Affective Computing and Intelligent Interaction
EGVE - JVRC'10 Proceedings of the 16th Eurographics conference on Virtual Environments & Second Joint Virtual Reality
Integrating semantic directional relationships into virtual environments: a meta-modelling approach
EGVE - JVRC'11 Proceedings of the 17th Eurographics conference on Virtual Environments & Third Joint Virtual Reality
Semantic modelling of interactive 3D content
JVRC '13 Proceedings of the 5th Joint Virtual Reality Conference
Hi-index | 0.00 |
This article describes the integration of knowledge based techniques into simulative Virtual Reality (VR) applications. The approach is motivated using multimodal Virtual Construction as an example domain. An abstract Knowledge Representation Layer (KRL) is proposed which is expressive enough to define all necessary data for diverse simulation tasks and which additionally provides a base formalism for the integration of Artificial Intelligence (AI) representations. The KRL supports two different implementation methods. The first method uses XSLT processing to transform the external KRL format into the representation formats of the diverse target systems. The second method implements the KRL using a functionally extendable semantic network. The semantic net library is tailored for real time simulation systems where it interconnects the required simulation modules and establishes access to the knowledge representations inside the simulation loop. The KRL promotes a novel object model for simulated objects called Semantic Entities which provides a uniform access to the KRL and which allows extensive system modularization. The KRL approach is demonstrated in two simulation areas. First, a generalized scene graph representation is presented which introduces an abstract definition and implementation of geometric node interrelations. It supports scene and application structures which can not be expressed using common scene hierarchies or field route concepts. Second, the KRL's expressiveness is demonstrated in the design of multimodal interactions. Here, the KRL defines the knowledge particularly required during the semantic analysis of multimodal user utterances.