Spatial ontology for semantic integration in 3D multimodal interaction framework

Authors:
Sylvia Irawati;Daniela Calderón;Heedong Ko
Affiliations:
University of Science and Technology, Korea Institute of Science and Technology;University of Science and Technology, Korea Institute of Science and Technology;University of Science and Technology, Korea Institute of Science and Technology
Venue:
Proceedings of the 2006 ACM international conference on Virtual reality continuum and its applications
Year:
2006

Citing 7
Cited 7

VRPN: a device-independent, network-transparent VR peripheral system

VRST '01 Proceedings of the ACM symposium on Virtual reality software and technology
“Put-that-there”: Voice and gesture at the graphics interface

SIGGRAPH '80 Proceedings of the 7th annual conference on Computer graphics and interactive techniques
A Real-Time Framework for Natural Multimodal Interaction with Large Screen Displays

ICMI '02 Proceedings of the 4th IEEE International Conference on Multimodal Interfaces
Mutual disambiguation of 3D multimodal interaction in augmented and virtual reality

Proceedings of the 5th international conference on Multimodal interfaces
3D User Interfaces: Theory and Practice

3D User Interfaces: Theory and Practice
Semantic Virtual Environments with Adaptive Multimodal Interfaces

MMM '05 Proceedings of the 11th International Multimedia Modelling Conference
Automatic Data Exchange and Synchronization for Knowledge-Based Intelligent Virtual Environments

VR '05 Proceedings of the 2005 IEEE Conference 2005 on Virtual Reality

Introducing semantic information during conceptual modelling of interaction for virtual environments

Proceedings of the 2007 workshop on Multimodal interfaces in semantic interaction
Towards multimodal human-robot interaction in large scale virtual environment

Proceedings of the 3rd ACM/IEEE international conference on Human robot interaction
A framework for designing adaptative systems in VR applications

CCNC'09 Proceedings of the 6th IEEE Conference on Consumer Communications and Networking Conference
Realsound interaction: a novel interaction method with mixed reality space by localizing sound events in real world

HCI'07 Proceedings of the 12th international conference on Human-computer interaction: interaction platforms and techniques
A framework for VR application based on spatial, temporal and semantic relationship

ICVR'07 Proceedings of the 2nd international conference on Virtual reality
Ensuring semantic spatial constraints in virtual environments using UML/OCL

Proceedings of the 17th ACM Symposium on Virtual Reality Software and Technology
A general framework for incremental processing of multimodal inputs

ICMI '11 Proceedings of the 13th international conference on multimodal interfaces

Quantified Score

Hi-index	0.01

Visualization

Abstract

This paper describes a framework for 3D selection and manipulation in virtual environments. The framework provides some basic selection and manipulation techniques to achieve the interaction task. It also provides more than one input channel to interact with the system. The gist of the proposed framework is the semantic integration of multimodal input using spatial ontology and user context to integrate the interpretation results from the inputs into a single one. The spatial ontology, describing the spatial relationships between objects, is used together with the current user context to solve ambiguities coming from the user's commands. We discuss how the spatial ontology is defined and used to assist the user to perform object placements in the virtual environment.