Syntax-based alignment of multiple translations: extracting paraphrases and generating new sentences

Authors:
Bo Pang;Kevin Knight;Daniel Marcu
Affiliations:
Cornell University, Ithaca, NY;University of Southern California, Marina Del Rey, CA;University of Southern California, Marina Del Rey, CA
Venue:
NAACL '03 Proceedings of the 2003 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology - Volume 1
Year:
2003

Citing 11
Cited 72

Lexical semantics and knowledge representation in multilingual text generation

Lexical semantics and knowledge representation in multilingual text generation
DIRT @SBT@discovery of inference rules from text

Proceedings of the seventh ACM SIGKDD international conference on Knowledge discovery and data mining
A maximum-entropy-inspired parser

NAACL 2000 Proceedings of the 1st North American chapter of the Association for Computational Linguistics conference
Generation that exploits corpus-based statistical knowledge

COLING '98 Proceedings of the 17th international conference on Computational linguistics - Volume 1
Anticipating the reader's problems and the automatic generation of paraphrases

COLING '94 Proceedings of the 15th conference on Computational linguistics - Volume 1
Information fusion in the context of multi-document summarization

ACL '99 Proceedings of the 37th annual meeting of the Association for Computational Linguistics on Computational Linguistics
Extracting paraphrases from a parallel corpus

ACL '01 Proceedings of the 39th Annual Meeting on Association for Computational Linguistics
Learning to paraphrase: an unsupervised approach using multiple-sequence alignment

NAACL '03 Proceedings of the 2003 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology - Volume 1
Bootstrapping lexical choice via multiple-sequence alignment

EMNLP '02 Proceedings of the ACL-02 conference on Empirical methods in natural language processing - Volume 10
Automatic paraphrase acquisition from news articles

HLT '02 Proceedings of the second international conference on Human Language Technology Research
Corpus-based comprehensive and diagnostic MT evaluation: initial Arabic, Chinese, French, and Spanish results

HLT '02 Proceedings of the second international conference on Human Language Technology Research

Learning to paraphrase: an unsupervised approach using multiple-sequence alignment

NAACL '03 Proceedings of the 2003 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology - Volume 1
Paraphrasing spoken Chinese using a paraphrase corpus

Natural Language Engineering
Sentence Fusion for Multidocument News Summarization

Computational Linguistics
Interrogative reformulation patterns and acquisition of question paraphrases

PARAPHRASE '03 Proceedings of the second international workshop on Paraphrasing - Volume 16
Paraphrase acquisition for information extraction

PARAPHRASE '03 Proceedings of the second international workshop on Paraphrasing - Volume 16
Paraphrasing with bilingual parallel corpora

ACL '05 Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics
Learning to say it well: reranking realizations by predicted synthesis quality

ACL-44 Proceedings of the 21st International Conference on Computational Linguistics and the 44th annual meeting of the Association for Computational Linguistics
Comparing semantically related sentences: the case of paraphrase versus subsumption

COLING '04 Proceedings of the 20th international conference on Computational Linguistics
Improved statistical machine translation using paraphrases

HLT-NAACL '06 Proceedings of the main conference on Human Language Technology Conference of the North American Chapter of the Association of Computational Linguistics
Acquisition of verb entailment from text

HLT-NAACL '06 Proceedings of the main conference on Human Language Technology Conference of the North American Chapter of the Association of Computational Linguistics
ParaEval: using paraphrases to evaluate summaries automatically

HLT-NAACL '06 Proceedings of the main conference on Human Language Technology Conference of the North American Chapter of the Association of Computational Linguistics
Paraphrasing for automatic evaluation

HLT-NAACL '06 Proceedings of the main conference on Human Language Technology Conference of the North American Chapter of the Association of Computational Linguistics
Stochastic iterative alignment for machine translation evaluation

COLING-ACL '06 Proceedings of the COLING/ACL on Main conference poster sessions
Adding syntax to dynamic programming for aligning comparable texts for the generation of paraphrases

COLING-ACL '06 Proceedings of the COLING/ACL on Main conference poster sessions
Discovery of event entailment knowledge from text corpora

Computer Speech and Language
Local Rephrasing Suggestions for Supporing the Work of Writers

GoTAL '08 Proceedings of the 6th international conference on Advances in Natural Language Processing
Training tree transducers

Computational Linguistics
Opinion Mining and Sentiment Analysis

Foundations and Trends in Information Retrieval
Constructing corpora for the development and evaluation of paraphrase systems

Computational Linguistics
Empirical Paraphrasing of Modern Greek Text in Two Phases: An Application to Steganography

CICLing '09 Proceedings of the 10th International Conference on Computational Linguistics and Intelligent Text Processing
Discovery of Entailment Relations from Event Co-Occurrences

Proceedings of the 2006 conference on ECAI 2006: 17th European Conference on Artificial Intelligence August 29 -- September 1, 2006, Riva del Garda, Italy
Improved Statistical Machine Translation Using Monolingual Paraphrases

Proceedings of the 2008 conference on ECAI 2008: 18th European Conference on Artificial Intelligence
Looking up phrase rephrasings via a pivot language

COGALEX '08 Proceedings of the workshop on Cognitive Aspects of the Lexicon
ParaMetric: an automatic evaluation metric for paraphrasing

COLING '08 Proceedings of the 22nd International Conference on Computational Linguistics - Volume 1
A framework for identifying textual redundancy

COLING '08 Proceedings of the 22nd International Conference on Computational Linguistics - Volume 1
Inference rules and their application to recognizing textual entailment

EACL '09 Proceedings of the 12th Conference of the European Chapter of the Association for Computational Linguistics
Avoiding repetition in generated text

ENLG '07 Proceedings of the Eleventh European Workshop on Natural Language Generation
Paraphrasing of Japanese light-verb constructions based on lexical conceptual structure

MWE '04 Proceedings of the Workshop on Multiword Expressions: Integrating Processing
Syntactic constraints on paraphrases extracted from parallel corpora

EMNLP '08 Proceedings of the Conference on Empirical Methods in Natural Language Processing
Unsupervised methods for determining object and relation synonyms on the web

Journal of Artificial Intelligence Research
Using paraphrases for parameter tuning in statistical machine translation

StatMT '07 Proceedings of the Second Workshop on Statistical Machine Translation
Recognizing entailment in intelligent tutoring systems*

Natural Language Engineering
Extracting paraphrase patterns from bilingual parallel corpora

Natural Language Engineering
Cross-lingual predicate cluster acquisition to improve bilingual event extraction by inductive learning

UMSLLS '09 Proceedings of the Workshop on Unsupervised and Minimally Supervised Learning of Lexical Semantics
Mutaphrase: paraphrasing with FrameNet

RTE '07 Proceedings of the ACL-PASCAL Workshop on Textual Entailment and Paraphrasing
Contextual bitext-derived paraphrases in automatic MT evaluation

StatMT '06 Proceedings of the Workshop on Statistical Machine Translation
Paraphrase recognition using machine learning to combine similarity measures

ACLstudent '09 Proceedings of the ACL-IJCNLP 2009 Student Research Workshop
Inference rules for recognizing textual entailment

IWCS-8 '09 Proceedings of the Eighth International Conference on Computational Semantics
Sub-sentential paraphrasing by contextual pivot translation

TextInfer '09 Proceedings of the 2009 Workshop on Applied Textual Inference
Language structure using fuzzy similarity

IEEE Transactions on Fuzzy Systems
Automatic alignment of common information in comparable sentences of Portuguese

Companion Proceedings of the XIV Brazilian Symposium on Multimedia and the Web
Interlingual annotation of parallel text corpora: A new framework for annotation and evaluation

Natural Language Engineering
Hitting the right paraphrases in good time

HLT '10 Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics
PEM: a paraphrase evaluation metric exploiting parallel texts

EMNLP '10 Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing
Leveraging multiple MT engines for paraphrase generation

COLING '10 Proceedings of the 23rd International Conference on Computational Linguistics
Comparison of paraphrase acquisition techniques on sentential paraphrases

IceTAL'10 Proceedings of the 7th international conference on Advances in natural language processing
A survey of paraphrasing and textual entailment methods

Journal of Artificial Intelligence Research
Generating phrasal and sentential paraphrases: A survey of data-driven methods

Computational Linguistics
Developing a corpus of plagiarised short answers

Language Resources and Evaluation
Collecting highly parallel data for paraphrase evaluation

HLT '11 Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies - Volume 1
Monolingual alignment by edit rate computation on sentential paraphrase pairs

HLT '11 Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies: short papers - Volume 2
An empirical evaluation of data-driven paraphrase generation techniques

HLT '11 Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies: short papers - Volume 2
Mavuno: a scalable and effective Hadoop-based paraphrase acquisition system

Proceedings of the Third Workshop on Large Scale Data Mining: Theory and Applications
Learning top-k transformation rules

DEXA'11 Proceedings of the 22nd international conference on Database and expert systems applications - Volume Part I
Web-based validation for contextual targeted paraphrasing

MTTG '11 Proceedings of the Workshop on Monolingual Text-To-Text Generation
Comparing phrase-based and syntax-based paraphrase generation

MTTG '11 Proceedings of the Workshop on Monolingual Text-To-Text Generation
Creating disjunctive logical forms from aligned sentences for grammar-based paraphrase generation

MTTG '11 Proceedings of the Workshop on Monolingual Text-To-Text Generation
Tiburon: a weighted tree automata toolkit

CIAA'06 Proceedings of the 11th international conference on Implementation and Application of Automata
An overview of probabilistic tree transducers for natural language processing

CICLing'05 Proceedings of the 6th international conference on Computational Linguistics and Intelligent Text Processing
Evaluating evaluation methods for generation in the presence of variation

CICLing'05 Proceedings of the 6th international conference on Computational Linguistics and Intelligent Text Processing
Reranking bilingually extracted paraphrases using monolingual distributional similarity

GEMS '11 Proceedings of the GEMS 2011 Workshop on GEometrical Models of Natural Language Semantics
Learning sentential paraphrases from bilingual parallel corpora for text-to-text generation

EMNLP '11 Proceedings of the Conference on Empirical Methods in Natural Language Processing
Acquiring synonyms from monolingual comparable texts

IJCNLP'05 Proceedings of the Second international joint conference on Natural Language Processing
Validation of sub-sentential paraphrases acquired from parallel monolingual corpora

EACL '12 Proceedings of the 13th Conference of the European Chapter of the Association for Computational Linguistics
Exploring grammatical error correction with not-so-crummy machine translation

Proceedings of the Seventh Workshop on Building Educational Applications Using NLP
Automatically mining question reformulation patterns from search log data

ACL '12 Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics: Short Papers - Volume 2
Enlarging paraphrase collections through generalization and instantiation

EMNLP-CoNLL '12 Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning
Generalizing sub-sentential paraphrase acquisition across original signal type of text pairs

EMNLP-CoNLL '12 Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning
Paraphrase substitution for recognizing textual entailment

CLEF'06 Proceedings of the 7th international conference on Cross-Language Evaluation Forum: evaluation of multilingual and multi-modal information retrieval
An abstractive approach to sentence compression

ACM Transactions on Intelligent Systems and Technology (TIST) - Special Sections on Paraphrasing; Intelligent Systems for Socially Aware Computing; Social Computing, Behavioral-Cultural Modeling, and Prediction
Multitechnique paraphrase alignment: A contribution to pinpointing sub-sentential paraphrases

ACM Transactions on Intelligent Systems and Technology (TIST) - Special Sections on Paraphrasing; Intelligent Systems for Socially Aware Computing; Social Computing, Behavioral-Cultural Modeling, and Prediction
Sentence fusion for multidocument news summarization

Computational Linguistics

Quantified Score

Hi-index	0.00

Visualization

Abstract

We describe a syntax-based algorithm that automatically builds Finite State Automata (word lattices) from semantically equivalent translation sets. These FSAs are good representations of paraphrases. They can be used to extract lexical and syntactic paraphrase pairs and to generate new, unseen sentences that express the same meaning as the sentences in the input sets. Our FSAs can also predict the correctness of alternative semantic renderings, which may be used to evaluate the quality of translations.