Independence assumptions considered harmful

Authors:
Alexander Franz
Affiliations:
Sony Computer Science Laboratory & D21 Laboratory, Sony Corporation, Kitashinagawa, Shinagawa-ku, Tokyo, Japan
Venue:
ACL '98 Proceedings of the 35th Annual Meeting of the Association for Computational Linguistics and Eighth Conference of the European Chapter of the Association for Computational Linguistics
Year:
1997

Citing 10
Cited 2

Semantic interpretation and the resolution of ambiguity

Semantic interpretation and the resolution of ambiguity
Word association norms, mutual information, and lexicography

Computational Linguistics
Training and scaling preference functions for disambiguation

Computational Linguistics
Automatic Ambiguity Resolution in Natural Language Processing: An Empirical Approach

Automatic Ambiguity Resolution in Natural Language Processing: An Empirical Approach
Pattern Classification (2nd Edition)

Pattern Classification (2nd Edition)
Structural ambiguity and lexical relations

Computational Linguistics - Special issue on using large corpora: I
Building a large annotated corpus of English: the penn treebank

Computational Linguistics - Special issue on using large corpora: II
Coping with ambiguity and unknown words through probabilistic models

Computational Linguistics - Special issue on using large corpora: II
Parsing the LOB corpus

ACL '90 Proceedings of the 28th annual meeting on Association for Computational Linguistics
A maximum entropy model for prepositional phrase attachment

HLT '94 Proceedings of the workshop on Human Language Technology

Statistical models for unsupervised prepositional phrase attachment

COLING '98 Proceedings of the 17th international conference on Computational linguistics - Volume 2
A Bayesian mixture model for term re-occurrence and burstiness

CONLL '05 Proceedings of the Ninth Conference on Computational Natural Language Learning

Quantified Score

Hi-index	0.00

Visualization

Abstract

Many current approaches to statistical language modeling rely on independence assumptions between the different explanatory variables. This results in models which are computationally simple, but which only model the main effects of the explanatory variables on the response variable. This paper presents an argument in favor of a statistical approach that also models the interactions between the explanatory variables. The argument rests on empirical evidence from two series of experimetns concerning automatic ambiguity resolution.