Coping with ambiguity and unknown words through probabilistic models

Authors:
Ralph Weischedel;Richard Schwartz;Jeff Palmucci;Marie Meteer;Lance Ramshaw
Affiliations:
BBN Systems and Technologies;BBN Systems and Technologies;BBN Systems and Technologies;Rensselaer Polytechnic Institute;Bowdoin College
Venue:
Computational Linguistics - Special issue on using large corpora: II
Year:
1993

Citing 14
Cited 84

Discovery procedures for sublanguage selectional patterns: initial experiments

Computational Linguistics
Grammatical category disambiguation by statistical optimization

Computational Linguistics
A Cache-Based Natural Language Model for Speech Recognition

IEEE Transactions on Pattern Analysis and Machine Intelligence
Rapid porting of the Parlance natural language interface

HLT '89 Proceedings of the workshop on Speech and Natural Language
Portability in the Janus Natural Language Interface

HLT '89 Proceedings of the workshop on Speech and Natural Language
Structural ambiguity and lexical relations

HLT '90 Proceedings of the workshop on Speech and Natural Language
Statistical parsing of messages

HLT '90 Proceedings of the workshop on Speech and Natural Language
A stochastic parts program and noun phrase parser for unrestricted text

ANLC '88 Proceedings of the second conference on Applied natural language processing
An environment for acquiring semantic information

ACL '87 Proceedings of the 25th annual meeting on Association for Computational Linguistics
Parsing the LOB corpus

ACL '90 Proceedings of the 28th annual meeting on Association for Computational Linguistics
Overview of the third message understanding evaluation and conference

MUC3 '91 Proceedings of the 3rd conference on Message understanding
Unification-based semantic interpretation in the BBN Spoken Language System

HLT '89 Proceedings of the workshop on Speech and Natural Language
Preference semantics for message understanding

HLT '89 Proceedings of the workshop on Speech and Natural Language
Augmenting a hidden Markov model for phrase-dependent word tagging

HLT '89 Proceedings of the workshop on Speech and Natural Language

Information extraction as a basis for high-precision text classification

ACM Transactions on Information Systems (TOIS)
Automatic stochastic tagging of natural language texts

Computational Linguistics
Deterministic part-of-speech tagging with finite-state transducers

Computational Linguistics
Transformation-based error-driven learning and natural language processing: a case study in part-of-speech tagging

Computational Linguistics
Learning to Parse Natural Language with Maximum Entropy Models

Machine Learning - Special issue on natural language learning
An Algorithm that Learns What‘s in a Name

Machine Learning - Special issue on natural language learning
A Machine Learning Approach to POS Tagging

Machine Learning
Syllable-pattern-based unknown-morpheme segmentation and estimation for hybrid part-of-speech tagging of Korean

Computational Linguistics
Treatment of Unknown Words

WIA '99 Revised Papers from the 4th International Workshop on Automata Implementation
A shallow parser based on closed-class words to capture relations in biomedical text

Journal of Biomedical Informatics
Automatic rule induction for unknown-word guessing

Computational Linguistics
Supertagging: an approach to almost parsing

Computational Linguistics
Review of "Beyond grammar: an experience-based theory of language" by Rens Bod. CSLI Publications 1998.

Computational Linguistics
Do all fragments count?

Natural Language Engineering
A lightweight dependency analyzer for partial parsing

Natural Language Engineering
A corpus-based bootstrapping algorithm for Semi-Automated semantic lexicon construction

Natural Language Engineering
Extracting molecular binding relationships from biomedical text

ANLC '00 Proceedings of the sixth conference on Applied natural language processing
Detecting errors within a corpus using anomaly detection

NAACL 2000 Proceedings of the 1st North American chapter of the Association for Computational Linguistics conference
A novel use of statistical parsing to extract information from text

NAACL 2000 Proceedings of the 1st North American chapter of the Association for Computational Linguistics conference
Tagging accurately: don't guess if you know

ANLC '94 Proceedings of the fourth conference on Applied natural language processing
The DINOUS parser

Natural Language Engineering
Nymble: a high-performance learning name-finder

ANLC '97 Proceedings of the fifth conference on Applied natural language processing
Unsupervised learning of part-of-speech guessing rules

Natural Language Engineering
A syntax-based part-of-speech analyser

EACL '95 Proceedings of the seventh conference on European chapter of the Association for Computational Linguistics
POS disambiguation and unknown word guessing with decision trees

EACL '99 Proceedings of the ninth conference on European chapter of the Association for Computational Linguistics
New models for improving supertag disambiguation

EACL '99 Proceedings of the ninth conference on European chapter of the Association for Computational Linguistics
Independence assumptions considered harmful

ACL '98 Proceedings of the 35th Annual Meeting of the Association for Computational Linguistics and Eighth Conference of the European Chapter of the Association for Computational Linguistics
Memory-based learning: using similarity for smoothing

ACL '98 Proceedings of the 35th Annual Meeting of the Association for Computational Linguistics and Eighth Conference of the European Chapter of the Association for Computational Linguistics
Tagging English by path voting constraints

COLING '98 Proceedings of the 17th international conference on Computational linguistics - Volume 2
Structural disambiguation based on reliable estimation of strength of association

COLING '98 Proceedings of the 17th international conference on Computational linguistics - Volume 2
Predicting part-of-speech information about unknown words using statistical methods

ACL '98 Proceedings of the 36th Annual Meeting of the Association for Computational Linguistics and 17th International Conference on Computational Linguistics - Volume 2
Classifier combination for improved lexical disambiguation

COLING '98 Proceedings of the 17th international conference on Computational linguistics - Volume 1
Part-of-speech tagging using a Variable Memory Markov model

ACL '94 Proceedings of the 32nd annual meeting on Association for Computational Linguistics
Detecting and correcting speech repairs

ACL '94 Proceedings of the 32nd annual meeting on Association for Computational Linguistics
Graded unification: a framework for interactive processing

ACL '94 Proceedings of the 32nd annual meeting on Association for Computational Linguistics
Unsupervised learning of word-category guessing rules

ACL '96 Proceedings of the 34th annual meeting on Association for Computational Linguistics
A hierarchical monothetic document clustering algorithm for summarization and browsing search results

Proceedings of the 13th international conference on World Wide Web
Parsing with the shortest derivation

COLING '00 Proceedings of the 18th conference on Computational linguistics - Volume 1
Improving part-of-speech tagging using lexicalized HMMs

Natural Language Engineering
Beyond skeleton parsing: producing a comprehensive large-scale general-English treebank with full grammatical analysis

COLING '96 Proceedings of the 16th conference on Computational linguistics - Volume 1
Markov random field based English part-of-speech tagging system

COLING '96 Proceedings of the 16th conference on Computational linguistics - Volume 1
Tagging and chunking with bigrams

COLING '00 Proceedings of the 18th conference on Computational linguistics - Volume 2
Learning part-of-speech guessing rules from lexicon: extension to non-concatenative operations

COLING '96 Proceedings of the 16th conference on Computational linguistics - Volume 2
A second-order Hidden Markov Model for part-of-speech tagging

ACL '99 Proceedings of the 37th annual meeting of the Association for Computational Linguistics on Computational Linguistics
A part of speech estimation method for Japanese unknown words using a statistical model of morphology and context

ACL '99 Proceedings of the 37th annual meeting of the Association for Computational Linguistics on Computational Linguistics
Use of a genetic algorithm in brill's transformation-based part-of-speech tagger

GECCO '05 Proceedings of the 7th annual conference on Genetic and evolutionary computation
A Morphological Tagger for Korean: Statistical Tagging Combined with Corpus-Based Morphological Rule Application

Machine Translation
BBN: description of the PLUM system as used for MUC-5

MUC5 '93 Proceedings of the 5th conference on Message understanding
BEN: description of the PLUM system as used for MUC-6

MUC6 '95 Proceedings of the 6th conference on Message understanding
University of Sheffield: description of the LaSIE system as used for MUC-6

MUC6 '95 Proceedings of the 6th conference on Message understanding
What is the minimal set of fragments that achieves maximal parse accuracy?

ACL '01 Proceedings of the 39th Annual Meeting on Association for Computational Linguistics
Tagging unknown proper names using decision trees

ACL '00 Proceedings of the 38th Annual Meeting on Association for Computational Linguistics
Language independent, minimally supervised induction of lexical probabilities

ACL '00 Proceedings of the 38th Annual Meeting on Association for Computational Linguistics
Tagging speech repairs

HLT '94 Proceedings of the workshop on Human Language Technology
A report of recent progress in transformation-based error-driven learning

HLT '94 Proceedings of the workshop on Human Language Technology
Natural-Language Understanding at BBN

IEEE Annals of the History of Computing
Minimal commitment and full lexical disambiguation: balancing rules and hidden Markov Models

ConLL '00 Proceedings of the 2nd workshop on Learning language in logic and the 4th conference on Computational natural language learning - Volume 7
A statistical model for parsing and word-sense disambiguation

EMNLP '00 Proceedings of the 2000 Joint SIGDAT conference on Empirical methods in natural language processing and very large corpora: held in conjunction with the 38th Annual Meeting of the Association for Computational Linguistics - Volume 13
Identification of probable real words: an entropy-based approach

ULA '02 Proceedings of the ACL-02 workshop on Unsupervised lexical acquisition - Volume 9
Progress in information extraction

TIPSTER '96 Proceedings of a workshop on held at Vienna, Virginia: May 6-8, 1996
Algorithms that learn to extract information: BBN: TIPSTER phase III

TIPSTER '98 Proceedings of a workshop on held at Baltimore, Maryland: October 13-15, 1998
BBN's PLUM Probabilistic Language Understanding system

TIPSTER '93 Proceedings of a workshop on held at Fredericksburg, Virginia: September 19-23, 1993
Domain-specific language models and lexicons for tagging

Journal of Biomedical Informatics
Automated extraction of Tree-Adjoining Grammars from treebanks

Natural Language Engineering
Exploiting unannotated corpora for tagging and chunking

ACLdemo '04 Proceedings of the ACL 2004 on Interactive poster and demonstration sessions
Discriminative hidden Markov modeling with long state dependence using a kNN ensemble

COLING '04 Proceedings of the 20th international conference on Computational Linguistics
Toward unsupervised whole-corpus tagging

COLING '04 Proceedings of the 20th international conference on Computational Linguistics
A backoff model for bootstrapping resources for non-English languages

HLT '05 Proceedings of the conference on Human Language Technology and Empirical Methods in Natural Language Processing
Design of a multi-lingual, parallel-processing statistical parsing engine

HLT '02 Proceedings of the second international conference on Human Language Technology Research
TaxaMiner: an experimentation framework for automated taxonomy bootstrapping

International Journal of Web and Grid Services
Part-of-speech tagging of modern hebrew text

Natural Language Engineering
Part-of-Speech Tagging Based on Machine Translation Techniques

IbPRIA '07 Proceedings of the 3rd Iberian conference on Pattern Recognition and Image Analysis, Part I
Part-of-Speech Tagging Using Word Probability Based on Category Patterns

CICLing '07 Proceedings of the 8th International Conference on Computational Linguistics and Intelligent Text Processing
Using semantic and syntactic graphs for call classification

FeatureEng '05 Proceedings of the ACL Workshop on Feature Engineering for Machine Learning in Natural Language Processing
Robust ending guessing rules with application to Slavonic languages

ROMAND '04 Proceedings of the 3rd Workshop on RObust Methods in Analysis of Natural Language Data
Discovering lexical information by tagging Arabic newspaper text

Semitic '98 Proceedings of the Workshop on Computational Approaches to Semitic Languages
Wrap-Up: a trainable discourse module for information extraction

Journal of Artificial Intelligence Research
Smoothing a lexicon-based POS tagger for Arabic and Hebrew

Semitic '07 Proceedings of the 2007 Workshop on Computational Approaches to Semitic Languages: Common Issues and Resources
Chinese syntactic category disambiguation using support vector machines

ISNN'05 Proceedings of the Second international conference on Advances in neural networks - Volume Part II
Decreasing lexical data sparsity in statistical syntactic parsing: experiments with named entities

MWE '11 Proceedings of the Workshop on Multiword Expressions: from Parsing and Generation to the Real World
The greedy prepend algorithm for decision list induction

ISCIS'06 Proceedings of the 21st international conference on Computer and Information Sciences
Shallow case role annotation using two-stage feature-enhanced string matching

CICLing'06 Proceedings of the 7th international conference on Computational Linguistics and Intelligent Text Processing
Mutual information independence model using kernel density estimation for segmenting and labeling sequential data

CICLing'05 Proceedings of the 6th international conference on Computational Linguistics and Intelligent Text Processing
Knowledge sources for constituent parsing of german, a morphologically rich and less-configurational language

Computational Linguistics

Quantified Score

Hi-index	0.00

Visualization

Abstract

From spring 1990 through fall 1991, we performed a battery of small experiments to test the effectiveness of supplementing knowledge-based techniques with probabilistic models. This paper reports our experiments in predicting parts of speech of highly ambiguous words, predicting the intended interpretation of an utterance when more than one interpretation satisfies all known syntactic and semantic constraints, and learning caseframe informationfor verbsfrom example uses.From these experiments, we are convinced that probabilistic models based on annotated corpora can effectively reduce the ambiguity in processing text and can be used to acquire lexical informationfrom a corpus, by supplementing knowledge-based techniques.Based on the results of those experiments, we have constructed a new natural language system (PLUM) for extracting data from text, e.g., newswire text.