Exploiting Psychological Factors for Interaction Style Recognition in Spoken Conversation

Authors:
Wen-Li Wei;Chung-Hsien Wu;Jen-Chun Lin;Han Li
Affiliations:
Department of Computer Science and Information Engineering, Multimedia Human Machine Communication Lab, National Cheng Kung University, Tainan, Taiwan;Department of Computer Science and Information Engineering, Multimedia Human Machine Communication Lab, National Cheng Kung University, Tainan, Taiwan;Department of Computer Science and Information Engineering, Multimedia Human Machine Communication Lab, National Cheng Kung University, Tainan, Taiwan;Department of Computer Science and Information Engineering, Multimedia Human Machine Communication Lab, National Cheng Kung University, Tainan, Taiwan
Venue:
IEEE/ACM Transactions on Audio, Speech and Language Processing (TASLP)
Year:
2014

Citing 21
Cited 0

Assessing agreement on classification tasks: the kappa statistic

Computational Linguistics
Affective computing

Affective computing
Improvising linguistic style: social and affective bases for agent personality

AGENTS '97 Proceedings of the first international conference on Autonomous agents
A Tutorial on Support Vector Machines for Pattern Recognition

Data Mining and Knowledge Discovery
Socially Aware Computation and Communication

Computer
Emotion recognition from text using semantic labels and separable mixture models

ACM Transactions on Asian Language Information Processing (TALIP)
Hidden Markov model-based speech emotion recognition

ICME '03 Proceedings of the 2003 International Conference on Multimedia and Expo - Volume 2
Ensemble methods for spoken emotion recognition in call-centres

Speech Communication
A robust multimodal approach for emotion recognition

Neurocomputing
Inter-coder agreement for computational linguistics

Computational Linguistics
Extracting social meaning: identifying interactional style in spoken conversation

NAACL '09 Proceedings of Human Language Technologies: The 2009 Annual Conference of the North American Chapter of the Association for Computational Linguistics
Social signal processing: Survey of an emerging domain

Image and Vision Computing
Using linguistic cues for the automatic recognition of personality in conversation and text

Journal of Artificial Intelligence Research
Class-level spectral features for emotion recognition

Speech Communication
Survey on speech emotion recognition: Features, classification schemes, and databases

Pattern Recognition
LIBSVM: A library for support vector machines

ACM Transactions on Intelligent Systems and Technology (TIST)
Emotion Recognition of Affective Speech Based on Multiple Classifiers Using Acoustic-Prosodic Information and Semantic Labels

IEEE Transactions on Affective Computing
Large scale personality classification of bloggers

ACII'11 Proceedings of the 4th international conference on Affective computing and intelligent interaction - Volume Part II
Modeling the Temporal Evolution of Acoustic Parameters for Speech Emotion Recognition

IEEE Transactions on Affective Computing
Fully Automatic Recognition of the Temporal Phases of Facial Actions

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
Error Weighted Semi-Coupled Hidden Markov Model for Audio-Visual Emotion Recognition

IEEE Transactions on Multimedia

Quantified Score

Hi-index	0.00

Visualization

Abstract

Determining how a speaker is engaged in a conversation is crucial for achieving harmonious interaction between computers and humans. In this study, a fusion approach was developed based on psychological factors to recognize Interaction Style ($IS$ ) in spoken conversation, which plays a key role in creating natural dialogue agents. The proposed Fused Cross-Correlation Model (FCCM) provides a unified probabilistic framework to model the relationships among the psychological factors of emotion, personality trait ($PT$), transient $IS$, and $IS$ history, for recognizing $IS$. An emotional arousal-dependent speech recognizer was used to obtain the recognized spoken text for extracting linguistic features to estimate transient $IS$ likelihood and recognize $PT$. A temporal course modeling approach and an emotional sub-state language model, based on the temporal phases of an emotional expression, were employed to obtain a better emotion recognition result. The experimental results indicate that the proposed FCCM yields satisfactory results in $IS$ recognition and also demonstrate that combining psychological factors effectively improves $IS$ recognition accuracy.