Multimodal transformed social interaction

Authors:
Matthew Turk;Jeremy Bailenson;Andrew Beall;Jim Blascovich;Rosanna Guadagno
Affiliations:
University of California, Santa Barbara, CA;Stanford University, Stanford, CA;University of California, Santa Barbara, CA;University of California, Santa Barbara, CA;University of California, Santa Barbara, CA
Venue:
Proceedings of the 6th international conference on Multimodal interfaces
Year:
2004

Citing 4
Cited 3

Multimodal human discourse: gesture and speech

ACM Transactions on Computer-Human Interaction (TOCHI)
Social interactions in multiscale CVEs

Proceedings of the 4th international conference on Collaborative virtual environments
The COVEN Project: Exploring Applicative, Technical, and Usage Dimensions of Collaborative Virtual Environments

Presence: Teleoperators and Virtual Environments
Transformed Social Interaction: Decoupling Representation from Behavior and Form in Collaborative Virtual Environments

Presence: Teleoperators and Virtual Environments

A model of attention and interest using Gaze behavior

Lecture Notes in Computer Science
Evaluating Perception of Interaction Initiation in Virtual Environments using Humanoid Agents

Proceedings of the 2006 conference on ECAI 2006: 17th European Conference on Artificial Intelligence August 29 -- September 1, 2006, Riva del Garda, Italy
Avatar interfaces for biobehavioral feedback

DUXU'13 Proceedings of the Second international conference on Design, User Experience, and Usability: health, learning, playing, cultural, and cross-cultural user experience - Volume Part II

Quantified Score

Hi-index	0.00

Visualization

Abstract

Understanding human-human interaction is fundamental to the long-term pursuit of powerful and natural multimodal interfaces. Nonverbal communication, including body posture, gesture, facial expression, and eye gaze, is an important aspect of human-human interaction. We introduce a paradigm for studying multimodal and nonverbal communication in collaborative virtual environments (CVEs) called Transformed Social Interaction (TSI), in which a user's visual representation is rendered in a way that strategically filters selected communication behaviors in order to change the nature of a social interaction. To achieve this, TSI must employ technology to detect, recognize, and manipulate behaviors of interest, such as facial expressions, gestures, and eye gaze. In [13] we presented a TSI experiment called non-zero-sum gaze (NZSG) to determine the effect of manipulated eye gaze on persuasion in a small group setting. Eye gaze was manipulated so that each participant in a three-person CVE received eye gaze from a presenter that was normal, less than normal, or greater than normal. We review this experiment and discuss the implications of TSI for multimodal interfaces.