Direct 3D interaction with smart objects
Proceedings of the ACM symposium on Virtual reality software and technology
InTml: a description language for VR applications
Proceedings of the seventh international conference on 3D Web technology
Model-Based Design and Evaluation of Interactive Applications
Model-Based Design and Evaluation of Interactive Applications
A toolset supported approach for designing and testing virtual environment interaction techniques
International Journal of Human-Computer Studies
Resolving Object References in Multimodal Dialogues for Immersive Virtual Environments
VR '04 Proceedings of the IEEE Virtual Reality 2004
Support for input adaptability in the ICON toolkit
Proceedings of the 6th international conference on Multimodal interfaces
Semantic Virtual Environments with Adaptive Multimodal Interfaces
MMM '05 Proceedings of the 11th International Multimedia Modelling Conference
Spatial ontology for semantic integration in 3D multimodal interaction framework
Proceedings of the 2006 ACM international conference on Virtual reality continuum and its applications
Semantic 3D object manipulation using object ontology in multimodal interaction framework
Proceedings of the 2005 international conference on Augmented tele-existence
Integrating support for usability evaluation into high level interaction descriptions with NiMMiT
DSVIS'06 Proceedings of the 13th international conference on Interactive systems: Design, specification, and verification
Extending a dialog model with contextual knowledge
TAMODIA'07 Proceedings of the 6th international conference on Task models and diagrams for user interface design
A formal description of multimodal interaction techniques for immersive virtual reality applications
INTERACT'05 Proceedings of the 2005 IFIP TC13 international conference on Human-Computer Interaction
A model-based design process for interactive virtual environments
DSVIS'05 Proceedings of the 12th international conference on Interactive Systems: design, specification, and verification
A systematic review of research on integration of ontologies with the model-driven approach
International Journal of Metadata, Semantics and Ontologies
Lessons from research on interaction with virtual environments
Journal of Network and Computer Applications
A serious game model for cultural heritage
Journal on Computing and Cultural Heritage (JOCCH)
Hi-index | 0.00 |
The integration of semantic information in virtual environment interaction is mostly still ad-hoc. The system is usually designed in such a way that the design of the framework incorporates the semantic information which then can be used to utilise these semantics during interaction. We introduce a model-based user interface approach which introduces semantic information, represented using ontologies, during the modelling phase. This semantic information itself is created during the design of the virtual world. The approach we propose is system independent and makes it possible for the semantic information content to be chosen and adapted in complete freedom without considering the underlying framework. We incorporate semantics in NiMMiT, our notation for multimodal interaction modelling. We present two case studies which validate the flexibility of our approach.