Identifying agreement and disagreement in conversational speech: use of Bayesian networks to model pragmatic dependencies

Authors:
Michel Galley;Kathleen McKeown;Julia Hirschberg;Elizabeth Shriberg
Affiliations:
Columbia University, New York, NY;Columbia University, New York, NY;Columbia University, New York, NY;Speech Technology and Research Laboratory, Menlo Park, CA
Venue:
ACL '04 Proceedings of the 42nd Annual Meeting on Association for Computational Linguistics
Year:
2004

Citing 8
Cited 45

A maximum entropy approach to natural language processing

Computational Linguistics
Discriminative Reranking for Natural Language Parsing

ICML '00 Proceedings of the Seventeenth International Conference on Machine Learning
Maximum Entropy Markov Models for Information Extraction and Segmentation

ICML '00 Proceedings of the Seventeenth International Conference on Machine Learning
Dialogue act modeling for automatic tagging and recognition of conversational speech

Computational Linguistics
Empirical studies on the disambiguation of cue phrases

Computational Linguistics
Predicting the semantic orientation of adjectives

ACL '98 Proceedings of the 35th Annual Meeting of the Association for Computational Linguistics and Eighth Conference of the European Chapter of the Association for Computational Linguistics
Detection of agreement vs. disagreement in meetings: training with unlabeled data

NAACL-Short '03 Proceedings of the 2003 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology: companion volume of the Proceedings of HLT-NAACL 2003--short papers - Volume 2
Statistical QA - classifier vs. re-ranker: what's the difference?

MultiSumQA '03 Proceedings of the ACL 2003 workshop on Multilingual summarization and question answering - Volume 12

Digesting virtual "geek" culture: the summarization of technical internet relay chats

ACL '05 Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics
Accessing speech data using strategic fixation

Computer Speech and Language
Dialogue act recognition under uncertainty using bayesian networks

Natural Language Engineering
Reliability measurement without limits

Computational Linguistics
First Steps Towards the Automatic Construction of Argument-Diagrams from Real Discussions

Proceedings of the 2006 conference on Computational Models of Argument: Proceedings of COMMA 2006
Automatic summarization of conversational multi-party speech

AAAI'06 proceedings of the 21st national conference on Artificial intelligence - Volume 2
Who is "you"?: combining linguistic and gaze features to resolve second-person references in dialogue

EACL '09 Proceedings of the 12th Conference of the European Chapter of the Association for Computational Linguistics
Get out the vote: determining support or opposition from congressional floor-debate transcripts

EMNLP '06 Proceedings of the 2006 Conference on Empirical Methods in Natural Language Processing
A skip-chain conditional random field for ranking meeting utterances by importance

EMNLP '06 Proceedings of the 2006 Conference on Empirical Methods in Natural Language Processing
Exploiting 'subjective' annotations

HumanJudge '08 Proceedings of the Workshop on Human Judgements in Computational Linguistics
Multimodal subjectivity analysis of multiparty conversation

EMNLP '08 Proceedings of the Conference on Empirical Methods in Natural Language Processing
Agreement/disagreement classification: exploiting unlabeled data using contrast classifiers

NAACL-Short '06 Proceedings of the Human Language Technology Conference of the NAACL, Companion Volume: Short Papers
Argumentative human computer dialogue for automated persuasion

SIGdial '08 Proceedings of the 9th SIGdial Workshop on Discourse and Dialogue
Modelling and detecting decisions in multi-party dialogue

SIGdial '08 Proceedings of the 9th SIGdial Workshop on Discourse and Dialogue
Agreement detection in multiparty conversation

Proceedings of the 2009 international conference on Multimodal interfaces
Real-time decision detection in multi-party dialogue

EMNLP '09 Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing: Volume 3 - Volume 3
Semi-supervised speech act recognition in emails and forums

EMNLP '09 Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing: Volume 3 - Volume 3
What do we know about conversation participants: experiments on conversation entailment

SIGDIAL '09 Proceedings of the SIGDIAL 2009 Conference: The 10th Annual Meeting of the Special Interest Group on Discourse and Dialogue
Extracting decisions from multi-party dialogue using directed graphical models and semantic similarity

SIGDIAL '09 Proceedings of the SIGDIAL 2009 Conference: The 10th Annual Meeting of the Special Interest Group on Discourse and Dialogue
Contrasting the interaction structure of an email and a telephone corpus: a machine learning approach to annotation of dialogue function units

SIGDIAL '09 Proceedings of the SIGDIAL 2009 Conference: The 10th Annual Meeting of the Special Interest Group on Discourse and Dialogue
Prosodic and gestural expression of interactional agreement

COST 2102'07 Proceedings of the 2007 COST action 2102 international conference on Verbal and nonverbal communication behaviours
Automatic decision detection in meeting speech

MLMI'07 Proceedings of the 4th international conference on Machine learning for multimodal interaction
Decision detection using hierarchical graphical models

ACLShort '10 Proceedings of the ACL 2010 Conference Short Papers
Towards conversation entailment: an empirical investigation

EMNLP '10 Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing
Support or oppose?: classifying positions in online debates from reply activities and opinion expressions

COLING '10 Proceedings of the 23rd International Conference on Computational Linguistics: Posters
Abstractive summarization of voice communications

LTC'09 Proceedings of the 4th conference on Human language technology: challenges for computer science and linguistics
Detection of agreement and disagreement in broadcast conversations

HLT '11 Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies: short papers - Volume 2
How can you say such things?!?: recognizing disagreement in informal political argument

LSM '11 Proceedings of the Workshop on Languages in Social Media
Annotating social acts: authority claims and alignment moves in Wikipedia talk pages

LSM '11 Proceedings of the Workshop on Languages in Social Media
Semantics extraction from social computing: a framework of reputation analysis on buzz marketing sites

DNIS'10 Proceedings of the 6th international conference on Databases in Networked Information Systems
Social media analysis determining the number of topic clusters from buzz marketing site

International Journal of Computational Science and Engineering
Participants' personal note-taking in meetings and its value for automatic meeting summarisation

Information Technology and Management
Survey on mining subjective data on the web

Data Mining and Knowledge Discovery
Leveraging editor collaboration patterns in wikipedia

Proceedings of the 23rd ACM conference on Hypertext and social media
Mining contentions from discussions and debates

Proceedings of the 18th ACM SIGKDD international conference on Knowledge discovery and data mining
Inferring pragmatics from dialogue contexts in simulated virtual agent games

AEGS'11 Proceedings of the 2011 international conference on Agents for Educational Games and Simulations
Modeling review comments

ACL '12 Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics: Long Papers - Volume 1
Detecting subgroups in online discussions by modeling positive and negative relations among participants

EMNLP-CoNLL '12 Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning
Using the omega index for evaluating abstractive community detection

Proceedings of Workshop on Evaluation Metrics and System Comparison for Automatic Summarization
Hierarchical conversation structure prediction in multi-party chat

SIGDIAL '12 Proceedings of the 13th Annual Meeting of the Special Interest Group on Discourse and Dialogue
Unifying local and global agreement and disagreement classification in online debates

WASSA '12 Proceedings of the 3rd Workshop in Computational Approaches to Subjectivity and Sentiment Analysis
Unsupervised discovery of opposing opinion networks from forum discussions

Proceedings of the 21st ACM international conference on Information and knowledge management
Towards the automatic detection of spontaneous agreement and disagreement based on nonverbal behaviour: A survey of related cues, databases, and tools

Image and Vision Computing
Modeling interaction features for debate side clustering

Proceedings of the 22nd ACM international conference on Conference on information & knowledge management
Conversation Analysis Based on Interpersonal Relationship in Consensus Building

Proceedings of International Conference on Information Integration and Web-based Applications & Services

Quantified Score

Hi-index	0.00

Visualization

Abstract

We describe a statistical approach for modeling agreements and disagreements in conversational interaction. Our approach first identifies adjacency pairs using maximum entropy ranking based on a set of lexical, durational, and structural features that look both forward and backward in the discourse. We then classify utterances as agreement or disagreement using these adjacency pairs and features that represent various pragmatic influences of previous agreement or disagreement on the current utterance. Our approach achieves 86.9% accuracy, a 4.9% increase over previous work.