Better k-best parsing

Authors:
Liang Huang;David Chiang
Affiliations:
University of Pennsylvania, Philadelphia, PA;University of Maryland, College Park, MD
Venue:
Parsing '05 Proceedings of the Ninth International Workshop on Parsing Technology
Year:
2005

Citing 27
Cited 102

Probabilistic reasoning in intelligent systems: networks of plausible inference

Probabilistic reasoning in intelligent systems: networks of plausible inference
Directed hypergraphs and applications

Discrete Applied Mathematics - Special issue: combinatorial structures and algorithms
Comment on a computing the k shortest paths in a graph

Communications of the ACM
On computing sets of shortest paths in a graph

Communications of the ACM
Introduction to Algorithms

Introduction to Algorithms
Semiring frameworks and algorithms for shortest-distance problems

Journal of Automata, Languages and Combinatorics
Automatic labeling of semantic roles

Computational Linguistics
Discriminative Reranking for Natural Language Parsing

ICML '00 Proceedings of the Seventeenth International Conference on Machine Learning
Weighted deductive parsing and Knuth's algorithm

Computational Linguistics
Parsing inside-out

Parsing inside-out
Building a large annotated corpus of English: the penn treebank

Computational Linguistics - Special issue on using large corpora: II
Semiring parsing

Computational Linguistics
A maximum-entropy-inspired parser

NAACL 2000 Proceedings of the 1st North American chapter of the Association for Computational Linguistics conference
Parsing with the shortest derivation

COLING '00 Proceedings of the 18th conference on Computational linguistics - Volume 1
Representation-based just-in-time specialization and the psyco prototype for python

Proceedings of the 2004 ACM SIGPLAN symposium on Partial evaluation and semantics-based program manipulation
Case-factor diagrams for structured probabilistic modeling

UAI '04 Proceedings of the 20th conference on Uncertainty in artificial intelligence
An integrated, conditional model of information extraction and coreference with application to citation matching

UAI '04 Proceedings of the 20th conference on Uncertainty in artificial intelligence
Minimum error rate training in statistical machine translation

ACL '03 Proceedings of the 41st Annual Meeting on Association for Computational Linguistics - Volume 1
The Alignment Template Approach to Statistical Machine Translation

Computational Linguistics
Intricacies of Collins' Parsing Model

Computational Linguistics
Head-Driven Statistical Models for Natural Language Parsing

Computational Linguistics
Online large-margin training of dependency parsers

ACL '05 Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics
Coarse-to-fine n-best parsing and MaxEnt discriminative reranking

ACL '05 Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics
A hierarchical phrase-based model for statistical machine translation

ACL '05 Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics
Finding the K shortest hyperpaths

Computers and Operations Research
Joint parsing and semantic role labeling

CONLL '05 Proceedings of the Ninth Conference on Computational Natural Language Learning
An overview of probabilistic tree transducers for natural language processing

CICLing'05 Proceedings of the 6th international conference on Computational Linguistics and Intelligent Text Processing

Maximum entropy based phrase reordering model for statistical machine translation

ACL-44 Proceedings of the 21st International Conference on Computational Linguistics and the 44th annual meeting of the Association for Computational Linguistics
An all-subtrees approach to unsupervised parsing

ACL-44 Proceedings of the 21st International Conference on Computational Linguistics and the 44th annual meeting of the Association for Computational Linguistics
Probabilistic context-free grammar induction based on structural zeros

HLT-NAACL '06 Proceedings of the main conference on Human Language Technology Conference of the North American Chapter of the Association of Computational Linguistics
Efficient algorithms for richer formalisms: parsing and machine translation

NAACL-DocConsortium '06 Proceedings of the 2006 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology: companion volume: doctoral consortium
Hierarchical Phrase-Based Translation

Computational Linguistics
Discourse generation using utility-trained coherence models

COLING-ACL '06 Proceedings of the COLING/ACL on Main conference poster sessions
Statistical machine translation

ACM Computing Surveys (CSUR)
Dynamic Programming Algorithms as Products of Weighted Logic Programs

ICLP '08 Proceedings of the 24th International Conference on Logic Programming
Unsupervised parsing with U-DOP

CoNLL-X '06 Proceedings of the Tenth Conference on Computational Natural Language Learning
Vine parsing and minimum risk reranking for speed and precision

CoNLL-X '06 Proceedings of the Tenth Conference on Computational Natural Language Learning
Improving statistical machine translation using lexicalized rule selection

COLING '08 Proceedings of the 22nd International Conference on Computational Linguistics - Volume 1
Cube summing, approximate inference with non-local features, and dynamic programming without semirings

EACL '09 Proceedings of the 12th Conference of the European Chapter of the Association for Computational Linguistics
Loss minimization in parse reranking

EMNLP '06 Proceedings of the 2006 Conference on Empirical Methods in Natural Language Processing
Solving the problem of cascading errors: approximate Bayesian inference for linguistic annotation pipelines

EMNLP '06 Proceedings of the 2006 Conference on Empirical Methods in Natural Language Processing
Forest-based translation rule extraction

EMNLP '08 Proceedings of the Conference on Empirical Methods in Natural Language Processing
A noisy-channel model of rational human sentence comprehension under uncertain input

EMNLP '08 Proceedings of the Conference on Empirical Methods in Natural Language Processing
Efficient extraction of oracle-best translations from hypergraphs

NAACL-Short '09 Proceedings of Human Language Technologies: The 2009 Annual Conference of the North American Chapter of the Association for Computational Linguistics, Companion Volume: Short Papers
Faster MT decoding through pervasive laziness

NAACL-Short '09 Proceedings of Human Language Technologies: The 2009 Annual Conference of the North American Chapter of the Association for Computational Linguistics, Companion Volume: Short Papers
MICA: a probabilistic dependency parser based on tree insertion grammars application note

NAACL-Short '09 Proceedings of Human Language Technologies: The 2009 Annual Conference of the North American Chapter of the Association for Computational Linguistics, Companion Volume: Short Papers
Efficiency in unification-based N-best parsing

IWPT '07 Proceedings of the 10th International Conference on Parsing Technologies
Nbest dependency parsing with linguistically rich models

IWPT '07 Proceedings of the 10th International Conference on Parsing Technologies
A scalable decoder for parsing-based machine translation with equivalent language model state maintenance

SSST '08 Proceedings of the Second Workshop on Syntax and Structure in Statistical Translation
Comparing reordering constraints for SMT using efficient Bleu oracle computation

SSST '07 Proceedings of the NAACL-HLT 2007/AMTA Workshop on Syntax and Structure in Statistical Translation
Joshua: an open source toolkit for parsing-based machine translation

StatMT '09 Proceedings of the Fourth Workshop on Statistical Machine Translation
A syntax-directed translator with extended domain of locality

CHSLP '06 Proceedings of the Workshop on Computationally Hard Problems and Joint Inference in Speech and Language Processing
Syntax augmented machine translation via chart parsing

StatMT '06 Proceedings of the Workshop on Statistical Machine Translation
Sub-sentence division for tree-based machine translation

ACLShort '09 Proceedings of the ACL-IJCNLP 2009 Conference Short Papers
Demonstration of Joshua: an open source toolkit for parsing-based machine translation

ACLDemos '09 Proceedings of the ACL-IJCNLP 2009 Software Demonstrations
Binarization of synchronous context-free grammars

Computational Linguistics
Forest-based tree sequence to string translation model

ACL '09 Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP: Volume 1 - Volume 1
Improving tree-to-tree translation with packed forests

ACL '09 Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP: Volume 2 - Volume 2
Joint decoding with multiple translation models

ACL '09 Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP: Volume 2 - Volume 2
k-best A* parsing

ACL '09 Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP: Volume 2 - Volume 2
Automatic adaptation of annotation standards for dependency parsing: using projected treebank as source corpus

IWPT '09 Proceedings of the 11th International Conference on Parsing Technologies
An incremental earley parser for simple range concatenation grammar

IWPT '09 Proceedings of the 11th International Conference on Parsing Technologies
Constructing parse forests that include exactly the n-best PCFG trees

IWPT '09 Proceedings of the 11th International Conference on Parsing Technologies
First- and second-order expectation semirings with applications to minimum-risk training on translation forests

EMNLP '09 Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing: Volume 1 - Volume 1
Statistical bistratal dependency parsing

EMNLP '09 Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing: Volume 2 - Volume 2
Fast translation rule matching for syntax-based statistical machine translation

EMNLP '09 Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing: Volume 2 - Volume 2
Lattice-based system combination for statistical machine translation

EMNLP '09 Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing: Volume 3 - Volume 3
K-best combination of syntactic parsers

EMNLP '09 Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing: Volume 3 - Volume 3
Deterministic pharmacophore detection via multiple flexible alignment of drug-like molecules

RECOMB'07 Proceedings of the 11th annual international conference on Research in computational molecular biology
Products of random latent variable grammars

HLT '10 Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics
Dependency parsing and projection based on word-pair classification

ACL '10 Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics
Hierarchical search for word alignment

ACL '10 Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics
Discriminative pruning for discriminative ITG alignment

ACL '10 Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics
Fine-grained tree-to-string translation rule extraction

ACL '10 Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics
Efficient inference through cascades of weighted tree transducers

ACL '10 Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics
A tree transducer model for synchronous tree-adjoining grammars

ACL '10 Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics
Dynamic programming for linear-time incremental parsing

ACL '10 Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics
Constituency to dependency translation with forests

ACL '10 Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics
Top-down k-best A* parsing

ACLShort '10 Proceedings of the ACL 2010 Conference Short Papers
cdec: a decoder, alignment, and learning framework for finite-state and context-free translation models

ACLDemos '10 Proceedings of the ACL 2010 System Demonstrations
Preservation of recognizability for synchronous tree substitution grammars

ATANLP '10 Proceedings of the 2010 Workshop on Applications of Tree Automata in Natural Language Processing
N-best parsing revisited

ATANLP '10 Proceedings of the 2010 Workshop on Applications of Tree Automata in Natural Language Processing
Soft syntactic constraints for hierarchical phrase-based translation using latent syntactic distributions

EMNLP '10 Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing
Non-isomorphic forest pair translation

EMNLP '10 Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing
Mixture model-based minimum Bayes risk decoding using multiple machine translation systems

COLING '10 Proceedings of the 23rd International Conference on Computational Linguistics
A novel reordering model based on multi-layer phrase for statistical machine translation

COLING '10 Proceedings of the 23rd International Conference on Computational Linguistics
Dependency forest for statistical machine translation

COLING '10 Proceedings of the 23rd International Conference on Computational Linguistics
Minimizing weighted tree grammars using simulation

FSMNLP'09 Proceedings of the 8th international conference on Finite-state methods and natural language processing
Querying probabilistic information extraction

Proceedings of the VLDB Endowment
An efficient shift-reduce decoding algorithm for phrased-based machine translation

COLING '10 Proceedings of the 23rd International Conference on Computational Linguistics: Posters
Effective constituent projection across languages

COLING '10 Proceedings of the 23rd International Conference on Computational Linguistics: Posters
Machine translation with lattices and forests

COLING '10 Proceedings of the 23rd International Conference on Computational Linguistics: Posters
String-to-dependency statistical machine translation

Computational Linguistics
Analyzing and integrating dependency parsers

Computational Linguistics
Products of weighted logic programs

Theory and Practice of Logic Programming
Effective use of function words for rule generalization in forest-based translation

HLT '11 Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies - Volume 1
Machine translation system combination by confusion forest

HLT '11 Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies - Volume 1
A coarse-to-fine approach to computing the k-best Viterbi paths

CPM'11 Proceedings of the 22nd annual conference on Combinatorial pattern matching
A decoding method of system combination based on hypergraph in SMT

AICI'11 Proceedings of the Third international conference on Artificial intelligence and computational intelligence - Volume Part III
Tiburon: a weighted tree automata toolkit

CIAA'06 Proceedings of the 11th international conference on Implementation and Application of Automata
Optimal search for minimum error rate training

EMNLP '11 Proceedings of the Conference on Empirical Methods in Natural Language Processing
Minimum imputed risk: unsupervised discriminative training for machine translation

EMNLP '11 Proceedings of the Conference on Empirical Methods in Natural Language Processing
Third-order variational reranking on packed-shared dependency forests

EMNLP '11 Proceedings of the Conference on Empirical Methods in Natural Language Processing
Tree parsing with synchronous tree-adjoining grammars

IWPT '11 Proceedings of the 12th International Conference on Parsing Technologies
Active learning for dependency parsing using partially annotated sentences

IWPT '11 Proceedings of the 12th International Conference on Parsing Technologies
Efficient parallel CKY parsing on GPUs

IWPT '11 Proceedings of the 12th International Conference on Parsing Technologies
Discontinuous data-oriented parsing: a mildly context-sensitive all-fragments grammar

SPMRL '11 Proceedings of the Second Workshop on Statistical Parsing of Morphologically Rich Languages
Weighted Extended Tree Transducers

Fundamenta Informaticae
Parsing time: learning to interpret time expressions

NAACL HLT '12 Proceedings of the 2012 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies
Unsupervised concept-to-text generation with hypergraphs

NAACL HLT '12 Proceedings of the 2012 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies
Cardinality pruning and language model heuristics for hierarchical phrase-based translation

Machine Translation
Deciding the twins property for weighted tree automata over extremal semifields

ATANLP '12 Proceedings of the Workshop on Applications of Tree Automata Techniques in Natural Language Processing
Empiricist solutions to nativist puzzles by means of unsupervised TSG

Proceedings of the Workshop on Computational Models of Language Acquisition and Loss
Akamon: an open source toolkit for tree/forest-based statistical machine translation

ACL '12 Proceedings of the ACL 2012 System Demonstrations
Dependency hashing for n-best CCG parsing

ACL '12 Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics: Long Papers - Volume 1
Iterative viterbi A* algorithm for k-best sequential decoding

ACL '12 Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics: Long Papers - Volume 1
Heuristic cube pruning in linear time

ACL '12 Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics: Short Papers - Volume 2
An exploration of forest-to-string translation: does translation help or hurt parsing?

ACL '12 Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics: Short Papers - Volume 2
Phrase-based approach for adaptive tokenization

SIGMORPHON '12 Proceedings of the Twelfth Meeting of the Special Interest Group on Computational Morphology and Phonology
Forced derivation tree based model training to statistical machine translation

EMNLP-CoNLL '12 Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning
Left-to-right tree-to-string decoding with prediction

EMNLP-CoNLL '12 Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning
Transliteration by sequence labeling with lattice encodings and reranking

NEWS '12 Proceedings of the 4th Named Entity Workshop
Global features for shallow discourse parsing

SIGDIAL '12 Proceedings of the 13th Annual Meeting of the Special Interest Group on Discourse and Dialogue
Towards probabilistic acceptors and transducers for feature structures

SSST-6 '12 Proceedings of the Sixth Workshop on Syntax, Semantics and Structure in Statistical Translation
Using syntactic head information in hierarchical phrase-based translation

WMT '12 Proceedings of the Seventh Workshop on Statistical Machine Translation
Parameterized top-K algorithms

Theoretical Computer Science
Learning to rank from structures in hierarchical text classification

ECIR'13 Proceedings of the 35th European conference on Advances in Information Retrieval
A global model for concept-to-text generation

Journal of Artificial Intelligence Research
Unsupervised sub-tree alignment for tree-to-tree translation

Journal of Artificial Intelligence Research

Quantified Score

Hi-index	0.00

Visualization

Abstract

We discuss the relevance of k-best parsing to recent applications in natural language processing, and develop efficient algorithms for k-best trees in the framework of hypergraph parsing. To demonstrate the efficiency, scalability and accuracy of these algorithms, we present experiments on Bikel's implementation of Collins' lexicalized PCFG model, and on Chiang's CFG-based decoder for hierarchical phrase-based translation. We show in particular how the improved output of our algorithms has the potential to improve results from parse reranking systems and other applications.