EmoHeart: conveying emotions in second life based on affect sensing from text

Authors:
Alena Neviarouskaya;Helmut Prendinger;Mitsuru Ishizuka
Affiliations:
Department of Information and Communication Engineering, University of Tokyo, Tokyo, Japan;Digital Content and Media Sciences Research Division, National Institute of Informatics, Tokyo, Japan;Department of Information and Communication Engineering, University of Tokyo, Tokyo, Japan
Venue:
Advances in Human-Computer Interaction - Special issue on emotion-aware natural interaction
Year:
2010

Citing 21
Cited 6

The effects of emotional icons on remote communication

Conference Companion on Human Factors in Computing Systems
Affective computing

Affective computing
Connecting: How We Form Social Bonds and Communities in the Internet Age

Connecting: How We Form Social Bonds and Communities in the Internet Age
A model of textual affect sensing using real-world knowledge

Proceedings of the 8th international conference on Intelligent user interfaces
The Design and Implementation of an Electronic Lexical Knowledge Base

AI '01 Proceedings of the 14th Biennial Conference of the Canadian Society on Computational Studies of Intelligence: Advances in Artificial Intelligence
Multimodality in Language and Speech Systems

Multimodality in Language and Speech Systems
Measuring praise and criticism: Inference of semantic orientation from association

ACM Transactions on Information Systems (TOIS)
Sentiment analysis: capturing favorability using natural language processing

Proceedings of the 2nd international conference on Knowledge capture
Exms: an animated and avatar-based messaging system for expressive peer communication

GROUP '03 Proceedings of the 2003 international ACM SIGGROUP conference on Supporting group work
Analysis of affect expressed through the evolving language of online communication

Proceedings of the 12th international conference on Intelligent user interfaces
Determining the sentiment of opinions

COLING '04 Proceedings of the 20th international conference on Computational Linguistics
Recognizing contextual polarity in phrase-level sentiment analysis

HLT '05 Proceedings of the conference on Human Language Technology and Empirical Methods in Natural Language Processing
A User Independent, Biosignal Based, Emotion Recognition Method

UM '07 Proceedings of the 11th international conference on User Modeling
Textual Affect Sensing for Sociable and Expressive Online Communication

ACII '07 Proceedings of the 2nd international conference on Affective Computing and Intelligent Interaction
Emotion Recognition through Multiple Modalities: Face, Body Gesture, Speech

Affect and Emotion in Human-Computer Interaction
Emotion Recognition with Poincare Mapping of Voiced-Speech Segments of Utterances

ICAISC '08 Proceedings of the 9th international conference on Artificial Intelligence and Soft Computing
User Study of AffectIM, an Emotionally Intelligent Instant Messaging System

IVA '08 Proceedings of the 8th international conference on Intelligent Virtual Agents
Face detection and recognition of natural human emotion using Markov random fields

Personal and Ubiquitous Computing
Conveying Emotions through Facially Animated Avatars in Networked Virtual Environments

Motion in Games
Dances with words

IJCAI'07 Proceedings of the 20th international joint conference on Artifical intelligence
Identifying expressions of emotion in text

TSD'07 Proceedings of the 10th international conference on Text, speech and dialogue

Innovative real-time communication system with rich emotional and haptic channels

EuroHaptics'10 Proceedings of the 2010 international conference on Haptics: generating and perceiving tangible sensations, Part I
Benefits of subliminal feedback loops in human-computer interaction

Advances in Human-Computer Interaction - Special issue on subliminal communication in human-computer interaction
"Emo Sim": expressing voice-based emotions in mobile interfaces

Proceedings of the 13th International Conference on Humans and Computers
Using individual light rigs to control the perception of a virtual character's personality

ACII'11 Proceedings of the 4th international conference on Affective computing and intelligent interaction - Volume Part I
Subjectivity and sentiment analysis: An overview of the current state of the area and envisaged developments

Decision Support Systems
Emotion detection state of the art

Proceedings of the CUBE International Information Technology Conference

Quantified Score

Hi-index	0.00

Visualization

Abstract

The 3D virtual world of "Second Life" imitates a form of real life by providing a space for rich interactions and social events. Second Life encourages people to establish or strengthen interpersonal relations, to share ideas, to gain new experiences, and to feel genuine emotions accompanying all adventures of virtual reality. Undoubtedly, emotions play a powerful role in communication. However, to trigger visual display of user's affective state in a virtual world, user has to manually assign appropriate facial expression or gesture to own avatar. Affect sensing from text, which enables automatic expression of emotions in the virtual environment, is a method to avoid manual control by the user and to enrich remote communications effortlessly. In this paper, we describe a lexical rule-based approach to recognition of emotions from text and an application of the developed Affect Analysis Model in Second Life. Based on the result of the Affect Analysis Model, the developed EmoHeart ("object" in Second Life) triggers animations of avatar facial expressions and visualizes emotion by heart-shaped textures.