Paralinguistics in speech and language-State-of-the-art and the challenge

Authors:
BjöRn Schuller;Stefan Steidl;Anton Batliner;Felix Burkhardt;Laurence Devillers;Christian MüLler;Shrikanth Narayanan
Affiliations:
CNRS-LIMSI, Spoken Language Processing Group, Orsay, France;International Computer Science Institute (ICSI), Berkeley, CA, USA and Friedrich-Alexander University Erlangen-Nuremberg, Pattern Recognition Lab, Germany;Friedrich-Alexander University Erlangen-Nuremberg, Pattern Recognition Lab, Germany;Deutsche Telekom AG, Telekom Innovation Laboratories, Berlin, Germany;CNRS-LIMSI, Spoken Language Processing Group, Orsay, France and Paris-Sorbonne IV University, GEMASS, Paris, France;German Research Center for Artificial Intelligence (DFKI), Saarbrücken, Germany;University of Southern California, SAIL, Los Angeles, CA, USA
Venue:
Computer Speech and Language
Year:
2013

Citing 63
Cited 5

Relations of sex and dialect to reduction

Speech Communication
Floating search methods in feature selection

Pattern Recognition Letters
The DCIEM Map Task Corpus: spontaneous dialogue under sleep deprivation and drug treatment

Speech Communication - Special issue on speech under stress
Approximate statistical tests for comparing supervised classification learning algorithms

Neural Computation
Modeling drivers' speech under stress

Speech Communication - Special issue on speech and emotion
The role of voice quality in communicating emotion, mood and attitude

Speech Communication - Special issue on speech and emotion
Vocal communication of emotion: a review of research paradigms

Speech Communication - Special issue on speech and emotion
Affective computing: challenges

International Journal of Human-Computer Studies - Application of affective computing in human—Computer interaction
Regularized multi--task learning

Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining
Automatic analysis of call-center conversations

Proceedings of the 14th ACM international conference on Information and knowledge management
Learning to estimate user interest utilizing the variational Bayes estimator

ISDA '05 Proceedings of the 5th International Conference on Intelligent Systems Design and Applications
2005 Special Issue: Challenges in real-life emotion annotation and machine learning based detection

Neural Networks - Special issue: Emotion and brain
ASR for emotional speech: Clarifying the issues and enhancing performance

Neural Networks - Special issue: Emotion and brain
Recognition of positive-negative attitude and its application to a spoken dialogue system

Systems and Computers in Japan
Whose thumb is it anyway?: classifying author personality from weblog text

COLING-ACL '06 Proceedings of the COLING/ACL on Main conference poster sessions
Multi-task learning for sequential data via iHMMs and the nested Dirichlet process

Proceedings of the 24th international conference on Machine learning
Audiovisual recognition of spontaneous interest within conversations

Proceedings of the 9th international conference on Multimodal interfaces
Private emotions versus social interaction: a data-driven approach towards analysing emotion in speech

User Modeling and User-Adapted Interaction
Fear-type emotion recognition for future audio-based surveillance systems

Speech Communication
Automatic Classification of Expressiveness in Speech: A Multi-corpus Study

Speaker Classification II
Language---Independent Speaker Classification over a Far---Field Microphone

Speaker Classification II
What Should a Generic Emotion Markup Language Be Able to Represent?

ACII '07 Proceedings of the 2nd international conference on Affective Computing and Intelligent Interaction
Static and Dynamic Modelling for the Recognition of Non-verbal Vocalisations in Conversational Speech

PIT '08 Proceedings of the 4th IEEE tutorial and research workshop on Perception and Interactive Technologies for Speech-Based Systems: Perception in Multimodal Dialogue Systems
An Extension of MPML with Emotion Recognition Functions Attached

IVA '08 Proceedings of the 8th international conference on Intelligent Virtual Agents
Mind as Machine: A History of Cognitive Science

Mind as Machine: A History of Cognitive Science
PEAKS - A system for the automatic evaluation of voice and speech disorders

Speech Communication
Charisma perception from text and speech

Speech Communication
Supporting the creative drive: investigating paralinguistic voice as a mode of interaction for artists with upper limb disabilities

Universal Access in the Information Society
Vocal Telekinesis: towards the development of voice-physical installations

Universal Access in the Information Society
Contrasting emotion-bearing laughter types in multiparticipant vocal activity detection for meetings

ICASSP '09 Proceedings of the 2009 IEEE International Conference on Acoustics, Speech and Signal Processing
Analytical features: a knowledge-based approach to audio feature generation

EURASIP Journal on Audio, Speech, and Music Processing
Social signal processing: Survey of an emerging domain

Image and Vision Computing
Being bored? Recognising natural interest by extensive audiovisual integration for real-life application

Image and Vision Computing
Modeling vocal interaction for text-independent participant characterization in multi-party conversation

SIGdial '08 Proceedings of the 9th SIGdial Workshop on Discourse and Dialogue
Using linguistic cues for the automatic recognition of personality in conversation and text

Journal of Artificial Intelligence Research
Efficient Bayesian task-level transfer learning

IJCAI'07 Proceedings of the 20th international joint conference on Artifical intelligence
Learning one more thing

IJCAI'95 Proceedings of the 14th international joint conference on Artificial intelligence - Volume 2
The WEKA data mining software: an update

ACM SIGKDD Explorations Newsletter
The physiological microphone (PMIC): A competitive alternative for speaker assessment in stress detection and speaker verification

Speech Communication
Class-level spectral features for emotion recognition

Speech Communication
Semi-supervised speaker identification under covariate shift

Signal Processing
Whodunnit - Searching for the most important feature types signalling emotion-related user states in speech

Computer Speech and Language
Detecting emotional state of a child in a conversational computer game

Computer Speech and Language
Opensmile: the munich versatile and fast open-source audio feature extractor

Proceedings of the international conference on Multimedia
RANSAC-based training data selection for emotion recognition from spontaneous speech

Proceedings of the 3rd international workshop on Affective interaction in natural environments
Use of nonverbal speech cues in social interaction between human and robot: emotional and interactional markers

Proceedings of the 3rd international workshop on Affective interaction in natural environments
The voice of personality: mapping nonverbal vocal behavior into trait attributions

Proceedings of the 2nd international workshop on Social signal processing
Speech emotion classification and public speaking skill assessment

HBU'10 Proceedings of the First international conference on Human behavior understanding
Constructing a spoken dialogue corpus for studying paralinguistic information in expressive conversation and analyzing its statistical/acoustic characteristics

Speech Communication
Automatically Assessing Personality from Speech

ICSC '10 Proceedings of the 2010 IEEE Fourth International Conference on Semantic Computing
Cross-Corpus Acoustic Emotion Recognition: Variances and Strategies

IEEE Transactions on Affective Computing
The Cross-Modal and Cross-Cultural Processing of Affective Information

Proceedings of the 2011 conference on Neural Nets WIRN10: Proceedings of the 20th Italian Workshop on Neural Nets
On the impact of children's emotional speech on acoustic and language models

EURASIP Journal on Audio, Speech, and Music Processing - Special issue on atypical speech
Automatic speech emotion recognition using modulation spectral features

Speech Communication
Affective speaker state analysis in the presence of reverberation

International Journal of Speech Technology
Tandem decoding of children's speech for keyword detection in a child-robot interaction scenario

ACM Transactions on Speech and Language Processing (TSLP)
Recognising realistic emotions and affect in speech: State of the art and lessons learnt from the first challenge

Speech Communication
Emotion recognition using a hierarchical binary decision tree approach

Speech Communication
RealTourist: a study of augmenting human-human and human-computer dialogue with eye-gaze overlay

INTERACT'05 Proceedings of the 2005 IFIP TC13 international conference on Human-Computer Interaction
Time-Frequency features extraction for infant directed speech discrimination

NOLISP'09 Proceedings of the 2009 international conference on Advances in Nonlinear Speech Processing
Multiple classifier systems for the recogonition of human emotions

MCS'10 Proceedings of the 9th international conference on Multiple Classifier Systems
Rachel: Design of an emotionally targeted interactive agent for children with autism

ICME '11 Proceedings of the 2011 IEEE International Conference on Multimedia and Expo
Modeling focus of attention for meeting indexing based on multiple cues

IEEE Transactions on Neural Networks

Ten recent trends in computational paralinguistics

COST'11 Proceedings of the 2011 international conference on Cognitive Behavioural Systems
Social signal and user adaptation in reinforcement learning-based dialogue management

Proceedings of the 2nd Workshop on Machine Learning for Interactive Systems: Bridging the Gap Between Perception, Action and Communication
Diagnosis of depression by behavioural signals: a multimodal approach

Proceedings of the 3rd ACM international workshop on Audio/visual emotion challenge
Hierarchical emotion classification using genetic algorithms

Proceedings of the Fourth Symposium on Information and Communication Technology
Vocal fatigue induced by prolonged oral reading: Analysis and detection

Computer Speech and Language

Quantified Score

Hi-index	0.00

Visualization

Abstract

Paralinguistic analysis is increasingly turning into a mainstream topic in speech and language processing. This article aims to provide a broad overview of the constantly growing field by defining the field, introducing typical applications, presenting exemplary resources, and sharing a unified view of the chain of processing. It then presents the first broader Paralinguistic Challenge organised at INTERSPEECH 2010 by the authors including a historical overview of the Challenge tasks of recognising age, gender, and affect, a summary of methods used by the participants, and their results. In addition, we present the new benchmark obtained by fusion of participants' predictions and conclude by discussing ten recent and emerging trends in the analysis of paralinguistics in speech and language.