More than words: inference of socially relevant information from nonverbal vocal cues in speech

Authors:
Alessandro Vinciarelli;Hugues Salamin;Gelareh Mohammadi;Khiet Truong
Affiliations:
University of Glasgow, Glasgow, UK and Idiap Research Institute, Martigny, Switzerland;University of Glasgow, Glasgow, UK;Idiap Research Institute, Martigny, Switzerland and EPFL, Lausanne, Switzerland;University of Twente, Enschede, The Netherlands
Venue:
Proceedings of the Third COST 2102 international training school conference on Toward autonomous, adaptive, and context-aware multimodal interfaces: theoretical and practical issues
Year:
2010

Citing 8
Cited 0

The contribution of prosodic boundary markers to the perceptual difference between read and spontaneous speech

Speech Communication
The contribution of intonation, segmental durations, and spectral features to the perception of a spontaneous and a read speaking style

Speech Communication
Pattern Recognition and Machine Learning (Information Science and Statistics)

Pattern Recognition and Machine Learning (Information Science and Statistics)
Data Mining: A Knowledge Discovery Approach

Data Mining: A Knowledge Discovery Approach
Broadcast news story segmentation using social network analysis and hidden markov models

Proceedings of the 15th international conference on Multimedia
Social signal processing: Survey of an emerging domain

Image and Vision Computing
Modeling dominance in group conversations using nonverbal activity cues

IEEE Transactions on Audio, Speech, and Language Processing - Special issue on multimodal processing in speech-based interactions
The AMI meeting corpus: a pre-announcement

MLMI'05 Proceedings of the Second international conference on Machine Learning for Multimodal Interaction

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper presents two examples of how nonverbal communication can be automatically detected and interpreted in terms of social phenomena. In particular, the presented approaches use simple prosodic features to distinguish between journalists and non-journalists in media, and extract social networks from turn-taking to recognize roles in different interaction settings (broadcast data and meetings). Furthermore, the article outlines some of the most interesting perspectives in this line of research.