SemEval-2012 task 7: choice of plausible alternatives: an evaluation of commonsense causal reasoning

Authors:
Andrew S. Gordon;Zornitsa Kozareva;Melissa Roemmele
Affiliations:
University of Southern California, Los Angeles, CA;University of Southern California, Marina del Rey, CA;Indiana University, Bloomington, IN
Venue:
SemEval '12 Proceedings of the First Joint Conference on Lexical and Computational Semantics - Volume 1: Proceedings of the main conference and the shared task, and Volume 2: Proceedings of the Sixth International Workshop on Semantic Evaluation
Year:
2012

Citing 9
Cited 2

Word association norms, mutual information, and lexicography

Computational Linguistics
CYC: a large-scale investment in knowledge infrastructure

Communications of the ACM
ConceptNet — A Practical Commonsense Reasoning Tool-Kit

BT Technology Journal
A decision-based approach to rhetorical parsing

ACL '99 Proceedings of the 37th annual meeting of the Association for Computational Linguistics on Computational Linguistics
AnalogySpace: reducing the dimensionality of common sense knowledge

AAAI'08 Proceedings of the 23rd national conference on Artificial intelligence - Volume 1
Analysis of discourse structure with syntactic dependencies and data-driven shift-reduce parsing

IWPT '09 Proceedings of the 11th International Conference on Parsing Technologies
Automatic construction of a large-scale situation ontology by mining how-to instructions from the web

Web Semantics: Science, Services and Agents on the World Wide Web
The PASCAL recognising textual entailment challenge

MLCW'05 Proceedings of the First international conference on Machine Learning Challenges: evaluating Predictive Uncertainty Visual Object Classification, and Recognizing Textual Entailment
UTDHLT: COPACETIC system for choosing plausible alternatives

SemEval '12 Proceedings of the First Joint Conference on Lexical and Computational Semantics - Volume 1: Proceedings of the main conference and the shared task, and Volume 2: Proceedings of the Sixth International Workshop on Semantic Evaluation

UTDHLT: COPACETIC system for choosing plausible alternatives

SemEval '12 Proceedings of the First Joint Conference on Lexical and Computational Semantics - Volume 1: Proceedings of the main conference and the shared task, and Volume 2: Proceedings of the Sixth International Workshop on Semantic Evaluation
Cause-effect relation learning

TextGraphs-7 '12 Workshop Proceedings of TextGraphs-7 on Graph-based Methods for Natural Language Processing

Quantified Score

Hi-index	0.00

Visualization

Abstract

SemEval-2012 Task 7 presented a deceptively simple challenge: given an English sentence as a premise, select the sentence amongst two alternatives that more plausibly has a causal relation to the premise. In this paper, we describe the development of this task and its motivation. We describe the two systems that competed in this task as part of SemEval-2012, and compare their results to those achieved in previously published research. We discuss the characteristics that make this task so difficult, and offer our thoughts on how progress can be made in the future.