Extracting social meaning: identifying interactional style in spoken conversation

Authors:
Dan Jurafsky;Rajesh Ranganath;Dan McFarland
Affiliations:
Stanford University;Stanford University;Stanford University
Venue:
NAACL '09 Proceedings of Human Language Technologies: The 2009 Annual Conference of the North American Chapter of the Association for Computational Linguistics
Year:
2009

Citing 5
Cited 9

Feature selection, L1 vs. L2 regularization, and rotational invariance

ICML '04 Proceedings of the twenty-first international conference on Machine learning
Socially Aware Computation and Communication

Computer
Computers that care: investigating the effects of orientation of emotion exhibited by an embodied computer agent

International Journal of Human-Computer Studies - Special issue: Subtle expressivity for characters and robots
Wired for Speech: How Voice Activates and Advances the Human-Computer Relationship

Wired for Speech: How Voice Activates and Advances the Human-Computer Relationship
Using linguistic cues for the automatic recognition of personality in conversation and text

Journal of Artificial Intelligence Research

It's not you, it's me: detecting flirting and its misperception in speed-dates

EMNLP '09 Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing: Volume 1 - Volume 1
A game-theoretic model of metaphorical bargaining

ACL '10 Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics
Which clustering do you want? inducing your ideal clustering with minimal feedback

Journal of Artificial Intelligence Research
Chameleons in imagined conversations: a new approach to understanding coordination of linguistic style in dialogs

CMCL '11 Proceedings of the 2nd Workshop on Cognitive Modeling and Computational Linguistics
Toward automating a human behavioral coding system for married couples' interactions using speech acoustic features

Speech Communication
Predicting speech overlaps from speech tokens and co-occurring body behaviours in dyadic conversations

Proceedings of the 15th ACM on International conference on multimodal interaction
Inferring social nature of conversations from words: Experiments on a corpus of everyday telephone conversations

Computer Speech and Language
Computing vocal entrainment: A signal-derived PCA-based quantification scheme with application to affect analysis in married couple interactions

Computer Speech and Language
Exploiting Psychological Factors for Interaction Style Recognition in Spoken Conversation

IEEE/ACM Transactions on Audio, Speech and Language Processing (TASLP)

Quantified Score

Hi-index	0.02

Visualization

Abstract

Automatically extracting social meaning and intention from spoken dialogue is an important task for dialogue systems and social computing. We describe a system for detecting elements of interactional style: whether a speaker is awkward, friendly, or flirtatious. We create and use a new spoken corpus of 991 4-minute speed-dates. Participants rated their interlocutors for these elements of style. Using rich dialogue, lexical, and prosodic features, we are able to detect flirtatious, awkward, and friendly styles in noisy natural conversational data with up to 75% accuracy, compared to a 50% baseline. We describe simple ways to extract relatively rich dialogue features, and analyze which features performed similarly for men and women and which were gender-specific.