Computer systems that learn: classification and prediction methods from statistics, neural nets, machine learning, and expert systems
Cranking: Combining Rankings Using Conditional Probability Models on Permutations
ICML '02 Proceedings of the Nineteenth International Conference on Machine Learning
A probabilistic account of logical metonymy
Computational Linguistics
Information fusion for multidocument summarization: paraphrasing and generation
Information fusion for multidocument summarization: paraphrasing and generation
Generating natural language summaries from multiple on-line sources
Computational Linguistics - Special issue on natural language generation
Empirically estimating order constraints for content planning in generation
ACL '01 Proceedings of the 39th Annual Meeting on Association for Computational Linguistics
BLEU: a method for automatic evaluation of machine translation
ACL '02 Proceedings of the 40th Annual Meeting on Association for Computational Linguistics
Automatic evaluation of summaries using N-gram co-occurrence statistics
NAACL '03 Proceedings of the 2003 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology - Volume 1
Minimum error rate training in statistical machine translation
ACL '03 Proceedings of the 41st Annual Meeting on Association for Computational Linguistics - Volume 1
Probabilistic text structuring: experiments with sentence ordering
ACL '03 Proceedings of the 41st Annual Meeting on Association for Computational Linguistics - Volume 1
Evaluation metrics for generation
INLG '00 Proceedings of the first international conference on Natural language generation - Volume 14
Modeling local coherence: an entity-based approach
ACL '05 Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics
Improving chronological sentence ordering by precedence relation
COLING '04 Proceedings of the 20th international conference on Computational Linguistics
Automatic evaluation of machine translation quality using n-gram co-occurrence statistics
HLT '02 Proceedings of the second international conference on Human Language Technology Research
Automatic text summarization of newswire: lessons learned from the document understanding conference
AAAI'05 Proceedings of the 20th national conference on Artificial intelligence - Volume 3
Inferring strategies for sentence ordering in multidocument news summarization
Journal of Artificial Intelligence Research
Evaluating centering for information ordering using corpora
Computational Linguistics
Coreference-inspired coherence modeling
HLT-Short '08 Proceedings of the 46th Annual Meeting of the Association for Computational Linguistics on Human Language Technologies: Short Papers
Evaluating unsupervised part-of-speech tagging for grammar induction
COLING '08 Proceedings of the 22nd International Conference on Computational Linguistics - Volume 1
EACL '09 Proceedings of the 12th Conference of the European Chapter of the Association for Computational Linguistics
Measuring variability in sentence ordering for news summarization
ENLG '07 Proceedings of the Eleventh European Workshop on Natural Language Generation
Extending the entity-grid coherence model to semantically related entities
ENLG '07 Proceedings of the Eleventh European Workshop on Natural Language Generation
Revisiting readability: a unified framework for predicting text quality
EMNLP '08 Proceedings of the Conference on Empirical Methods in Natural Language Processing
Tree linearization in English: improving language model based approaches
NAACL-Short '09 Proceedings of Human Language Technologies: The 2009 Annual Conference of the North American Chapter of the Association for Computational Linguistics, Companion Volume: Short Papers
An evaluation understudy for dialogue coherence models
SIGdial '08 Proceedings of the 9th SIGdial Workshop on Discourse and Dialogue
A bottom-up approach to sentence ordering for multi-document summarization
Information Processing and Management: an International Journal
Investigations on word senses and word usages
ACL '09 Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP: Volume 1 - Volume 1
Content modeling using latent permutations
Journal of Artificial Intelligence Research
Studies on intrinsic summary evaluation
International Journal of Artificial Intelligence and Soft Computing
Metrics for MT evaluation: evaluating reordering
Machine Translation
Entity-based local coherence modelling using topological fields
ACL '10 Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics
Improved unsupervised POS induction using intrinsic clustering quality and a Zipfian constraint
CoNLL '10 Proceedings of the Fourteenth Conference on Computational Natural Language Learning
COLING '10 Proceedings of the 23rd International Conference on Computational Linguistics: Posters
Eliciting domain expert misuseability conceptions
Proceedings of the sixth international conference on Knowledge capture
Sentence ordering driven by local and global coherence for summary generation
HLT-SS '11 Proceedings of the ACL 2011 Student Session
In-domain relation discovery with meta-constraints via posterior regularization
HLT '11 Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies - Volume 1
Disentangling chat with local coherence models
HLT '11 Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies - Volume 1
Structural topic model for latent topical structure analysis
HLT '11 Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies - Volume 1
Aggregation of multiple judgments for evaluating ordered lists
ECIR'2010 Proceedings of the 32nd European conference on Advances in Information Retrieval
A preference learning approach to sentence ordering for multi-document summarization
Information Sciences: an International Journal
Extending the entity-based coherence model with multiple ranks
EACL '12 Proceedings of the 13th Conference of the European Chapter of the Association for Computational Linguistics
SemEval-2012 task 4: evaluating Chinese word similarity
SemEval '12 Proceedings of the First Joint Conference on Lexical and Computational Semantics - Volume 1: Proceedings of the main conference and the shared task, and Volume 2: Proceedings of the Sixth International Workshop on Semantic Evaluation
Answering opinion questions on products by exploiting hierarchical organization of consumer reviews
EMNLP-CoNLL '12 Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning
Towards content-level coherence with aspect-guided summarization
ACM Transactions on Speech and Language Processing (TSLP)
Challenges and opportunities of local journalism: a case study of the 2012 Korean general election
Proceedings of the 5th Annual ACM Web Science Conference
Sequential Summarization: A Full View of Twitter Trending Topics
IEEE/ACM Transactions on Audio, Speech and Language Processing (TASLP)
On the Accuracy of Packet Delay Estimation in Distributed Service Networks
Journal of Network and Systems Management
| Hi-index | 0.00 |
This article considers the automatic evaluation of information ordering, a task underlying many text-based applications such as concept-to-text generation and multidocument summarization. We propose an evaluation method based on Kendall's τ, a metric of rank correlation. The method is inexpensive, robust, and representation independent. We show that Kendall's τ correlates reliably with human ratings and reading times.