Integration and synchronization of input modes during multimodal human-computer interaction
Proceedings of the ACM SIGCHI Conference on Human factors in computing systems
Fragmented interaction: establishing mutual orientation in virtual environments
CSCW '98 Proceedings of the 1998 ACM conference on Computer supported cooperative work
Toward a theory of organized multimodal integration patterns during human-computer interaction
Proceedings of the 5th international conference on Multimodal interfaces
Evaluating effectiveness of interaction techniques across immersive virtual environmental systems
Presence: Teleoperators and Virtual Environments - Special issue: Immersive projection technology
Perception of Shared Visual Space: Establishing Common Ground in Real and Virtual Environments
Presence: Teleoperators and Virtual Environments
Gestures over video streams to support remote collaboration on physical tasks
Human-Computer Interaction
| Hi-index | 0.00 |
This paper describes the current results and future developments of a project on multimodal spatial reference in mediated environments. The database consists of video-recorded sessions, with 120 participants in three experimental designs, contrasting types of pointing (No Pointing, Natural Pointing, Mediated Pointing), types of co-presence (Mediated versus Natural) and type of task (Locative versus Descriptive). The project investigates which verbal and non-verbal resources participants prefer to use in the different conditions, and which integration strategies they adopt. The goal, relevant to people interested in communication with/through technologies, or in multimodal communication in general, is to clarify the pragmatic meaning of the different resources. So far, the analysis of the data has focused on the verbal resources; further analysis will focus on the pointing strategies, and their integration with verbal spatial reference.