Multimodal virtual environments: response times, attention, and presence

Authors:
David Hecht;Miriam Reiner;Gad Halevy
Affiliations:
Technion - Israel Institute of Technology, Department of Education in Technology and Science, Haifa, Israel and The University of Haifa, Haifa, Israel;Technion - Israel Institute of Technology, Department of Education in Technology and Science, Haifa, Israel;Technion - Israel Institute of Technology, Department of Education in Technology and Science, Haifa, Israel
Venue:
Presence: Teleoperators and Virtual Environments - Special issue: 8th annual international workshop on presence II
Year:
2006

Citing 8
Cited 7

Telepresence

Presence: Teleoperators and Virtual Environments - Premier issue
Musings on telepresence and virtual presence

Presence: Teleoperators and Virtual Environments - Premier issue
An experimental study on the role of touch in shared virtual environments

ACM Transactions on Computer-Human Interaction (TOCHI) - Special issue on human-computer interaction and collaborative virtual environments
Visual Touch in Virtual Environments: An Exploratory Study of Presence, Multimodal Interfaces, and Cross-Modal Sensory Illusions

Presence: Teleoperators and Virtual Environments
Measuring Presence in Virtual Environments: A Presence Questionnaire

Presence: Teleoperators and Virtual Environments
A Virtual Presence Counter

Presence: Teleoperators and Virtual Environments
Enhancement of perceived visual intensity by auditory stimuli: A psychophysical analysis

Journal of Cognitive Neuroscience
The role of haptics in immersive telecommunication environments

IEEE Transactions on Circuits and Systems for Video Technology

A New Approach to Design an Interactive System for Molecular Analysis

Proceedings of the 13th International Conference on Human-Computer Interaction. Part IV: Interacting in Various Application Domains
VR-CAD integration: Multimodal immersive interaction and advanced haptic paradigms for implicit edition of CAD models

Computer-Aided Design
The influence of passive haptic feedback and difference interaction metaphors on presence and task performance

Presence: Teleoperators and Virtual Environments
Learning in multimodal training: Visual guidance can be both appealing and disadvantageous in spatial tasks

International Journal of Human-Computer Studies
Impact of multimodal feedback on simulated ergonomic measurements in a virtual environment: A case study with manufacturing workers

Human Factors in Ergonomics & Manufacturing
Haptics and graphic analogies for the understanding of atomic force microscopy

International Journal of Human-Computer Studies
The influence of different sensory cues as selection feedback and co-location in presence and task performance

Multimedia Tools and Applications

Quantified Score

Hi-index	0.00

Visualization

Abstract

Multimodal virtual environments (VE) succeed better than single-sensory technologies in creating a sense of presence. We hypothesize that the underlying cognitive mechanism is related to a faster mental processing of multimodal events. Comparing simple detection times of unimodal (auditory, visual, and haptic) events, with bimodal and trimodal combinations, we show that mental processing times are in the following order: unimodal bimodal trimodal. Given this processing-speed advantage, multimodal VE users start their cognitive process faster, thus, in a similar exposure time they can pay attention to more informative cues and subtle details in the environment and integrate them creatively. This richer, more complete and coherent experience may contribute to an enhanced sense of presence.