Classification of feedback expressions in multimodal data

Authors:
Costanza Navarretta;Patrizia Paggio
Affiliations:
University of Copenhagen, Njalsgade, Copenhagen;University of Copenhagen, Njalsgade, Copenhagen
Venue:
ACLShort '10 Proceedings of the ACL 2010 Conference Short Papers
Year:
2010

Citing 12
Cited 3

Contextual recognition of head gestures

ICMI '05 Proceedings of the 7th international conference on Multimodal interfaces
Data Mining: Practical Machine Learning Tools and Techniques, Second Edition (Morgan Kaufmann Series in Data Management Systems)

Data Mining: Practical Machine Learning Tools and Techniques, Second Edition (Morgan Kaufmann Series in Data Management Systems)
Head gestures for perceptual interfaces: The role of context in improving recognition

Artificial Intelligence
Distinguishing the Communicative Functions of Gestures

MLMI '08 Proceedings of the 5th international workshop on Machine Learning for Multimodal Interaction
Exploring Features and Classifiers for Dialogue Act Segmentation

MLMI '08 Proceedings of the 5th international workshop on Machine Learning for Multimodal Interaction
Detecting Action Items in Meetings

MLMI '08 Proceedings of the 5th international workshop on Machine Learning for Multimodal Interaction
Inter-coder agreement for computational linguistics

Computational Linguistics
Combining lexical, syntactic and prosodic cues for improved online dialog act tagging

Computer Speech and Language
Hidden naive Bayes

AAAI'05 Proceedings of the 20th national conference on Artificial intelligence - Volume 2
Turn-yielding cues in task-oriented dialogue

SIGDIAL '09 Proceedings of the SIGDIAL 2009 Conference: The 10th Annual Meeting of the Special Interest Group on Discourse and Dialogue
A probabilistic multimodal approach for predicting listener backchannels

Autonomous Agents and Multi-Agent Systems
On the contextual analysis of agreement scores

Multimodal corpora

Annotating non-verbal behaviours in informal interactions

COST'10 Proceedings of the 2010 international conference on Analysis of Verbal and Nonverbal Communication and Enactment
Individuality in communicative bodily behaviours

COST'11 Proceedings of the 2011 international conference on Cognitive Behavioural Systems
Predicting speech overlaps from speech tokens and co-occurring body behaviours in dyadic conversations

Proceedings of the 15th ACM on International conference on multimodal interaction

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper addresses the issue of how linguistic feedback expressions, prosody and head gestures, i.e. head movements and face expressions, relate to one another in a collection of eight video-recorded Danish map-task dialogues. The study shows that in these data, prosodic features and head gestures significantly improve automatic classification of dialogue act labels for linguistic expressions of feedback.