Sentic avatar: multimodal affective conversational agent with common sense

Authors:
Erik Cambria;Isabelle Hupont;Amir Hussain;Eva Cerezo;Sandra Baldassarri
Affiliations:
University of Stirling, Stirling, UK;Aragon Institute of Technology, Zaragoza, Spain;University of Stirling, Stirling, UK;University of Zaragoza, Zaragoza, Spain;University of Zaragoza, Zaragoza, Spain
Venue:
Proceedings of the Third COST 2102 international training school conference on Toward autonomous, adaptive, and context-aware multimodal interfaces: theoretical and practical issues
Year:
2010

Citing 17
Cited 1

Frustrating the user on purpose: using biosignals in a pilot study to detect the user's emotional state

CHI 98 Cconference Summary on Human Factors in Computing Systems
Data Mining: Practical Machine Learning Tools and Techniques, Second Edition (Morgan Kaufmann Series in Data Management Systems)

Data Mining: Practical Machine Learning Tools and Techniques, Second Edition (Morgan Kaufmann Series in Data Management Systems)
Seeing stars: exploiting class relationships for sentiment categorization with respect to rating scales

ACL '05 Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics
Recognizing contextual polarity in phrase-level sentiment analysis

HLT '05 Proceedings of the conference on Human Language Technology and Empirical Methods in Natural Language Processing
Automatic discrimination between laughter and speech

Speech Communication
Bi-modal emotion recognition from expressive face and body gestures

Journal of Network and Computer Applications
How to distinguish posed from spontaneous smiles using geometric features

Proceedings of the 9th international conference on Multimodal interfaces
Sentiment analysis in multiple languages: Feature selection for opinion classification in Web forums

ACM Transactions on Information Systems (TOIS)
Chaos and Graphics: Maxine: A platform for embodied animated agents

Computers and Graphics
Real-Time Facial Expression Recognition for Natural Interaction

IbPRIA '07 Proceedings of the 3rd Iberian conference on Pattern Recognition and Image Analysis, Part II
Digital Intuition: Applying Common Sense Using Dimensionality Reduction

IEEE Intelligent Systems
Mining opinion features in customer reviews

AAAI'04 Proceedings of the 19th national conference on Artifical intelligence
Discourse level opinion interpretation

COLING '08 Proceedings of the 22nd International Conference on Computational Linguistics - Volume 1
Common sense computing: from the society of mind to digital intuition and beyond

BioID_MultiComm'09 Proceedings of the 2009 joint COST 2101 and 2102 international conference on Biometric ID management and multimodal communication
Modeling naturalistic affective states via facial, vocal, and bodily expressions recognition

ICMI'06/IJCAI'07 Proceedings of the ICMI 2006 and IJCAI 2007 international conference on Artifical intelligence for human computing
Sentic computing: exploitation of common sense for the development of emotion-sensitive systems

COST'09 Proceedings of the Second international conference on Development of Multimodal Interfaces: active Listening and Synchrony
Sentic Computing for social media marketing

Multimedia Tools and Applications

Classifying unlabeled short texts using a fuzzy declarative approach

Language Resources and Evaluation

Quantified Score

Hi-index	0.00

Visualization

Abstract

The capability of perceiving and expressing emotions through different modalities is a key issue for the enhancement of human-computer interaction. In this paper we present a novel architecture for the development of intelligent multimodal affective interfaces. It is based on the integration of Sentic Computing, a new opinion mining and sentiment analysis paradigm based on AI and Semantic Web techniques, with a facial emotional classifier and Maxine, a powerful multimodal animation engine for managing virtual agents and 3D scenarios. One of the main distinguishing features of the system is that it does not simply perform emotional classification in terms of a set of discrete emotional labels but it operates in a continuous 2D emotional space, enabling the integration of the different affective extraction modules in a simple and scalable way.