A structured vector space model for word meaning in context

Authors:
Katrin Erk;Sebastian Padó
Affiliations:
University of Texas at Austin;Stanford University
Venue:
EMNLP '08 Proceedings of the Conference on Empirical Methods in Natural Language Processing
Year:
2008

Citing 16
Cited 54

Tensor product variable binding and the representation of symbolic structures in connectionist systems

Artificial Intelligence - On connectionist symbol processing
A vector space model for automatic indexing

Communications of the ACM
Automatic labeling of semantic roles

Computational Linguistics
Structural ambiguity and lexical relations

Computational Linguistics - Special issue on using large corpora: I
Automatic word sense discrimination

Computational Linguistics - Special issue on word sense disambiguation
Automatic retrieval and clustering of similar words

COLING '98 Proceedings of the 17th international conference on Computational linguistics - Volume 2
Principle-based parsing without overgeneration

ACL '93 Proceedings of the 31st annual meeting on Association for Computational Linguistics
More accurate tests for the statistical significance of result differences

COLING '00 Proceedings of the 18th conference on Computational linguistics - Volume 2
Evaluating and combining approaches to selectional preference acquisition

EACL '03 Proceedings of the tenth conference on European chapter of the Association for Computational Linguistics - Volume 1
Disambiguating Nouns, Verbs, and Adjectives Using Automatically Acquired Selectional Preferences

Computational Linguistics
A distributional model of semantic context effects in lexical processing

ACL '04 Proceedings of the 42nd Annual Meeting on Association for Computational Linguistics
Dependency-Based Construction of Semantic Space Models

Computational Linguistics
Introduction to Information Retrieval

Introduction to Information Retrieval
Kernels on linguistic structures for answer extraction

HLT-Short '08 Proceedings of the 46th Annual Meeting of the Association for Computational Linguistics on Human Language Technologies: Short Papers
SemEval-2007 task 10: English lexical substitution task

SemEval '07 Proceedings of the 4th International Workshop on Semantic Evaluations
The PASCAL recognising textual entailment challenge

MLCW'05 Proceedings of the First international conference on Machine Learning Challenges: evaluating Predictive Uncertainty Visual Object Classification, and Recognizing Textual Entailment

Representing words as regions in vector space

CoNLL '09 Proceedings of the Thirteenth Conference on Computational Natural Language Learning
Investigations on word senses and word usages

ACL '09 Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP: Volume 1 - Volume 1
Supporting inferences in semantic space: representing words as regions

IWCS-8 '09 Proceedings of the Eighth International Conference on Computational Semantics
Improved statistical machine translation using monolingually-derived paraphrases

EMNLP '09 Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing: Volume 1 - Volume 1
Language models based on semantic composition

EMNLP '09 Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing: Volume 1 - Volume 1
Estimating semantic distance using soft semantic constraints in knowledge-source-corpus hybrid models

EMNLP '09 Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing: Volume 2 - Volume 2
Web-scale distributional similarity and entity set expansion

EMNLP '09 Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing: Volume 2 - Volume 2
One distributional memory, many semantic spaces

GEMS '09 Proceedings of the Workshop on Geometrical Models of Natural Language Semantics
BagPack: a general framework to represent semantic relations

GEMS '09 Proceedings of the Workshop on Geometrical Models of Natural Language Semantics
Paraphrase assessment in structured vector space: exploring parameters and datasets

GEMS '09 Proceedings of the Workshop on Geometrical Models of Natural Language Semantics
Context-theoretic semantics for natural language: an overview

GEMS '09 Proceedings of the Workshop on Geometrical Models of Natural Language Semantics
Ranking paraphrases in context

TextInfer '09 Proceedings of the 2009 Workshop on Applied Textual Inference
Towards a matrix-based distributional model of meaning

HLT-SRWS '10 Proceedings of the NAACL HLT 2010 Student Research Workshop
Contextualizing semantic representations using syntactically enriched vector models

ACL '10 Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics
Exemplar-based models for word meaning in context

ACLShort '10 Proceedings of the ACL 2010 Conference Short Papers
From frequency to meaning: vector space models of semantics

Journal of Artificial Intelligence Research
What is word meaning, really?: (and how can distributional models help us describe it?)

GEMS '10 Proceedings of the 2010 Workshop on GEometrical Models of Natural Language Semantics
Expectation vectors: a semiotics inspired approach to geometric lexical-semantic representation

GEMS '10 Proceedings of the 2010 Workshop on GEometrical Models of Natural Language Semantics
Measuring distributional similarity in context

EMNLP '10 Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing
A mixture model with sharing for lexical semantics

EMNLP '10 Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing
Nouns are vectors, adjectives are matrices: representing adjective-noun constructions in semantic space

EMNLP '10 Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing
A structured vector space model for hidden attribute meaning in adjective-noun phrases

COLING '10 Proceedings of the 23rd International Conference on Computational Linguistics
Estimating linear models for compositional distributional semantics

COLING '10 Proceedings of the 23rd International Conference on Computational Linguistics
Distributional lexical semantics: Toward uniform representation paradigms for advanced acquisition and processing tasks

Natural Language Engineering
Topic models for meaning similarity in context

COLING '10 Proceedings of the 23rd International Conference on Computational Linguistics: Posters
Distributional memory: A general framework for corpus-based semantics

Computational Linguistics
A flexible, corpus-driven model of regular and inverse selectional preferences

Computational Linguistics
Template-based information extraction without the templates

HLT '11 Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies - Volume 1
Integrating logical representations with probabilistic information using Markov logic

IWCS '11 Proceedings of the Ninth International Conference on Computational Semantics
Concrete sentence spaces for compositional distributional models of meaning

IWCS '11 Proceedings of the Ninth International Conference on Computational Semantics
Compositional expectation: a purely distributional model of compositional semantics

IWCS '11 Proceedings of the Ninth International Conference on Computational Semantics
Structured composition of semantic vectors

IWCS '11 Proceedings of the Ninth International Conference on Computational Semantics
Composing and updating verb argument expectations: a distributional semantic model

CMCL '11 Proceedings of the 2nd Workshop on Cognitive Modeling and Computational Linguistics
Domain based semantic compression for automatic text comprehension augmentation and recommendation

ICCCI'11 Proceedings of the Third international conference on Computational collective intelligence: technologies and applications - Volume Part II
(Linear) maps of the impossible: capturing semantic anomalies in distributional space

DiSCo '11 Proceedings of the Workshop on Distributional Semantics and Compositionality
Experimenting with transitive verbs in a DisCoCat

GEMS '11 Proceedings of the GEMS 2011 Workshop on GEometrical Models of Natural Language Semantics
Latent vector weighting for word meaning in context

EMNLP '11 Proceedings of the Conference on Empirical Methods in Natural Language Processing
Probabilistic models of similarity in syntactic context

EMNLP '11 Proceedings of the Conference on Empirical Methods in Natural Language Processing
Experimental support for a categorical compositional distributional model of meaning

EMNLP '11 Proceedings of the Conference on Empirical Methods in Natural Language Processing
A quick tour of word sense disambiguation, induction and related approaches

SOFSEM'12 Proceedings of the 38th international conference on Current Trends in Theory and Practice of Computer Science
Space projections as distributional models for semantic composition

CICLing'12 Proceedings of the 13th international conference on Computational Linguistics and Intelligent Text Processing - Volume Part I
Evaluating distributional models of semantics for syntactically invariant inference

EACL '12 Proceedings of the 13th Conference of the European Chapter of the Association for Computational Linguistics
A comparison of models of word meaning in context

NAACL HLT '12 Proceedings of the 2012 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies
Word Activation Forces: Distinctive Statistics Revealing Word Associations

Wireless Personal Communications: An International Journal
Saarland: vector-based models of semantic textual similarity

SemEval '12 Proceedings of the First Joint Conference on Lexical and Computational Semantics - Volume 1: Proceedings of the main conference and the shared task, and Volume 2: Proceedings of the Sixth International Workshop on Semantic Evaluation
Domain and function: a dual-space model of semantic relations and compositions

Journal of Artificial Intelligence Research
Domain adaptation of a dependency parser with a class-class selectional preference model

ACL '12 Proceedings of ACL 2012 Student Research Workshop
Distributional techniques for philosophical enquiry

LaTeCH '12 Proceedings of the 6th Workshop on Language Technology for Cultural Heritage, Social Sciences, and Humanities
Improving word representations via global context and multiple word prototypes

ACL '12 Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics: Long Papers - Volume 1
First-order vs. higher-order modification in distributional semantics

EMNLP-CoNLL '12 Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning
Robust plagiary detection using semantic compression augmented SHAPD

ICCCI'12 Proceedings of the 4th international conference on Computational Collective Intelligence: technologies and applications - Volume Part I
Distributional phrasal paraphrase generation for statistical machine translation

ACM Transactions on Intelligent Systems and Technology (TIST) - Special Sections on Paraphrasing; Intelligent Systems for Socially Aware Computing; Social Computing, Behavioral-Cultural Modeling, and Prediction
An inference-based model of word meaning in context as a paraphrase distribution

ACM Transactions on Intelligent Systems and Technology (TIST) - Special Sections on Paraphrasing; Intelligent Systems for Socially Aware Computing; Social Computing, Behavioral-Cultural Modeling, and Prediction
Composition of semantic relations: Theoretical framework and case study

ACM Transactions on Speech and Language Processing (TSLP)

Quantified Score

Hi-index	0.00

Visualization

Abstract

We address the task of computing vector space representations for the meaning of word occurrences, which can vary widely according to context. This task is a crucial step towards a robust, vector-based compositional account of sentence meaning. We argue that existing models for this task do not take syntactic structure sufficiently into account. We present a novel structured vector space model that addresses these issues by incorporating the selectional preferences for words' argument positions. This makes it possible to integrate syntax into the computation of word meaning in context. In addition, the model performs at and above the state of the art for modeling the contextual adequacy of paraphrases.