Natural language techniques for intelligent information retrieval
SIGIR '88 Proceedings of the 11th annual international ACM SIGIR conference on Research and development in information retrieval
Generating summaries of multiple news articles
SIGIR '95 Proceedings of the 18th annual international ACM SIGIR conference on Research and development in information retrieval
Human subjectivity and performance limits in document retrieval
Information Processing and Management: an International Journal - Special issue: history of information science
New Methods in Automatic Extracting
Journal of the ACM (JACM)
Advances in Automatic Text Summarization
Advances in Automatic Text Summarization
Cross-document summarization by concept classification
SIGIR '02 Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval
Cumulated gain-based evaluation of IR techniques
ACM Transactions on Information Systems (TOIS)
Summarization evaluation using relative utility
CIKM '03 Proceedings of the twelfth international conference on Information and knowledge management
Centroid-based summarization of multiple documents
Information Processing and Management: an International Journal
Automatic evaluation of summaries using N-gram co-occurrence statistics
NAACL '03 Proceedings of the 2003 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology - Volume 1
Probabilistic text structuring: experiments with sentence ordering
ACL '03 Proceedings of the 41st Annual Meeting on Association for Computational Linguistics - Volume 1
Improving chronological ordering of sentences extracted from multiple newspaper articles
ACM Transactions on Asian Language Information Processing (TALIP)
Automated text summarization and the SUMMARIST system
TIPSTER '98 Proceedings of a workshop on held at Baltimore, Maryland: October 13-15, 1998
A bottom-up approach to sentence ordering for multi-document summarization
ACL-44 Proceedings of the 21st International Conference on Computational Linguistics and the 44th annual meeting of the Association for Computational Linguistics
Automatic Evaluation of Information Ordering: Kendall's Tau
Computational Linguistics
The relationship between IR effectiveness measures and user satisfaction
SIGIR '07 Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval
Automatic summarising: The state of the art
Information Processing and Management: an International Journal
A new rank correlation coefficient for information retrieval
Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval
The automatic creation of literature abstracts
IBM Journal of Research and Development
Improving traceability link recovery methods through software artifact summarization
Proceedings of the 6th International Workshop on Traceability in Emerging Forms of Software Engineering
Investigation on tracking system for real time video surveillance applications
Proceedings of the CUBE International Information Technology Conference
| Hi-index | 0.00 |
Summary evaluation has gained importance in the research community and seems to be a quite challenging task. Most of the work till date focus on summary generation, while this paper focus on intrinsic summary evaluation. Studies made for preparing the 'Gold Standard' reference summary present some of the key issues in preparing a reference summary. Spearman, Kendall's W, and Kendall's rank correlation coefficients have been used for measuring inter-judge rank correlation. Existing drawbacks in Precision-Recall based evaluation and utility-based evaluation schemes were analysed. A new measure, called 'Effectiveness', to measure the system performance at given compression rate has been introduced.