Probabilistic models for disambiguation of an HPSG-based chart generator

Authors:
Hiroko Nakanishi;Yusuke Miyao;Jun'ichi Tsujii
Affiliations:
University of Tokyo, Bunkyo-ku, Tokyo, Japan;University of Tokyo, Bunkyo-ku, Tokyo, Japan;University of Tokyo, Bunkyo-ku, Tokyo, Japan and CREST, JST, Kawaguchi-shi, Saitama, Japan and University of Manchester, Manchester, UK
Venue:
Parsing '05 Proceedings of the Ninth International Workshop on Parsing Technology
Year:
2005

Citing 14
Cited 28

A maximum entropy approach to natural language processing

Computational Linguistics
The syntactic process

The syntactic process
Building a large annotated corpus of English: the penn treebank

Computational Linguistics - Special issue on using large corpora: II
Forest-based statistical sentence generation

NAACL 2000 Proceedings of the 1st North American chapter of the Association for Computational Linguistics conference
Generation that exploits corpus-based statistical knowledge

COLING '98 Proceedings of the 17th international conference on Computational linguistics - Volume 1
Chart generation

ACL '96 Proceedings of the 34th annual meeting on Association for Computational Linguistics
Exploiting a probabilistic hierarchical model for generation

COLING '00 Proceedings of the 18th conference on Computational linguistics - Volume 1
Parsing strategies with 'lexicalized' grammars: application to tree adjoining grammars

COLING '88 Proceedings of the 12th conference on Computational linguistics - Volume 2
BLEU: a method for automatic evaluation of machine translation

ACL '02 Proceedings of the 40th Annual Meeting on Association for Computational Linguistics
Feature selection for a rich HPSG grammar using decision trees

COLING-02 proceedings of the 6th conference on Natural language learning - Volume 20
Probabilistic disambiguation models for wide-coverage HPSG parsing

ACL '05 Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics
Efficacy of beam thresholding, unification filtering and hybrid parsing in probabilistic HPSG parsing

Parsing '05 Proceedings of the Ninth International Workshop on Parsing Technology
Iterative CKY parsing for probabilistic context-free grammars

IJCNLP'04 Proceedings of the First international joint conference on Natural Language Processing
Corpus-Oriented grammar development for acquiring a head-driven phrase structure grammar from the penn treebank

IJCNLP'04 Proceedings of the First international joint conference on Natural Language Processing

Robust PCFG-based generation using automatically acquired LFG approximations

ACL-44 Proceedings of the 21st International Conference on Computational Linguistics and the 44th annual meeting of the Association for Computational Linguistics
Feature forest models for probabilistic hpsg parsing

Computational Linguistics
Dependency-based n-gram models for general purpose sentence realisation

COLING '08 Proceedings of the 22nd International Conference on Computational Linguistics - Volume 1
Human evaluation of a German surface realisation ranker

EACL '09 Proceedings of the 12th Conference of the European Chapter of the Association for Computational Linguistics
Statistical ranking in tactical generation

EMNLP '06 Proceedings of the 2006 Conference on Empirical Methods in Natural Language Processing
Stochastic realisation ranking for a free word order language

ENLG '07 Proceedings of the Eleventh European Workshop on Natural Language Generation
A more precise analysis of punctuation for broad-coverage surface realization with CCG

GEAF '08 Proceedings of the Workshop on Grammar Engineering Across Frameworks
Exploiting named entity classes in CCG surface realization

NAACL-Short '09 Proceedings of Human Language Technologies: The 2009 Annual Conference of the North American Chapter of the Association for Computational Linguistics, Companion Volume: Short Papers
Sentence realisation from bag of words with dependency constraints

SRWS '09 Proceedings of Human Language Technologies: The 2009 Annual Conference of the North American Chapter of the Association for Computational Linguistics, Companion Volume: Student Research Workshop and Doctoral Consortium
Dependency based Chinese sentence realization

ACL '09 Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP: Volume 2 - Volume 2
Natural language generation with tree conditional random fields

EMNLP '09 Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing: Volume 1 - Volume 1
Perceptron reranking for CCG realization

EMNLP '09 Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing: Volume 1 - Volume 1
Accurate and robust LFG-based generation for Chinese

INLG '08 Proceedings of the Fifth International Natural Language Generation Conference
Parser-based retraining for domain adaptation of probabilistic generators

INLG '08 Proceedings of the Fifth International Natural Language Generation Conference
Phrase-based statistical language generation using graphical models and active learning

ACL '10 Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics
A simple domain-independent probabilistic approach to generation

EMNLP '10 Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing
Feature selection for fluency ranking

INLG '10 Proceedings of the 6th International Natural Language Generation Conference
Finding common ground: towards a surface realisation shared task

INLG '10 Proceedings of the 6th International Natural Language Generation Conference
Human evaluation of a german surface realisation ranker

Empirical methods in natural language generation
Designing agreement features for realization ranking

COLING '10 Proceedings of the 23rd International Conference on Computational Linguistics: Posters
Underspecifying and predicting voice for surface realisation ranking

HLT '11 Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies - Volume 1
Reversible stochastic attribute-value grammars

HLT '11 Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies: short papers - Volume 2
Dependency-based n-gram models for general purpose sentence realisation

Natural Language Engineering
Glue rules for robust chart realization

ENLG '11 Proceedings of the 13th European Workshop on Natural Language Generation
The first surface realisation shared task: overview and evaluation results

ENLG '11 Proceedings of the 13th European Workshop on Natural Language Generation
DCU*at generation challenges 2011 surface realisation track

ENLG '11 Proceedings of the 13th European Workshop on Natural Language Generation
Linguistically motivated complementizer choice in surface realization

UCNLG+EVAL '11 Proceedings of the UCNLG+Eval: Language Generation and Evaluation Workshop
Minimal dependency length in realization ranking

EMNLP-CoNLL '12 Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning

Quantified Score

Hi-index	0.00

Visualization

Abstract

We describe probabilistic models for a chart generator based on HPSG. Within the research field of parsing with lexicalized grammars such as HPSG, recent developments have achieved efficient estimation of probabilistic models and high-speed parsing guided by probabilistic models. The focus of this paper is to show that two essential techniques -- model estimation on packed parse forests and beam search during parsing -- are successfully exported to the task of natural language generation. Additionally, we report empirical evaluation of the performance of several disambiguation models and how the performance changes according to the feature set used in the models and the size of training data.