Summarizing text documents: sentence selection and evaluation metrics
Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval
Creating and evaluating multi-document sentence extract summaries
Proceedings of the ninth international conference on Information and knowledge management
Generating indicative-informative summaries with sumUM
Computational Linguistics - Summarization
Extracting Conceptual Relationships from Specialized Documents
ER '02 Proceedings of the 21st International Conference on Conceptual Modeling
The diversity-based approach to open-domain text summarization
Information Processing and Management: an International Journal
Principles of Context-Based Machine Translation Evaluation
Machine Translation
Geographical information recognition and visualization in texts written in various languages
Proceedings of the 2004 ACM symposium on Applied computing
The need for accurate alignment in natural language system evaluation
Computational Linguistics
SUMMAC: a text summarization evaluation
Natural Language Engineering
Validating the TEMAA LE evaluation methodology: a case study on Danish spelling checkers
Natural Language Engineering
Making MIRACLEs: Interactive translingual search for Cebuano and Hindi
ACM Transactions on Asian Language Information Processing (TALIP)
Steps toward a cognitive vision system
AI Magazine
World wide web site summarization
Web Intelligence and Agent Systems
Meta-evaluation of summaries in a cross-lingual environment using content-based metrics
COLING '02 Proceedings of the 19th international conference on Computational linguistics - Volume 1
Producing biographical summaries: combining linguistic knowledge with corpus statistics
ACL '01 Proceedings of the 39th Annual Meeting on Association for Computational Linguistics
Automatic evaluation of summaries using N-gram co-occurrence statistics
NAACL '03 Proceedings of the 2003 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology - Volume 1
Extracting conceptual relationships from specialized documents
Data & Knowledge Engineering - Special issue: ER 2002
When is an embedded MT system "good enough" for filtering?
NAACL-ANLP-EMTS '00 Proceedings of the 2000 NAACL-ANLP Workshop on Embedded machine translation systems - Volume 5
Usability evaluation in spoken language dialogue systems
ELDS '01 Proceedings of the workshop on Evaluation for Language and Dialogue Systems - Volume 9
Verification and validation of language processing systems: is it evaluation?
ELDS '01 Proceedings of the workshop on Evaluation for Language and Dialogue Systems - Volume 9
The ARC A3 project: terminology acquisition tools: evaluation method and task
ELDS '01 Proceedings of the workshop on Evaluation for Language and Dialogue Systems - Volume 9
Using a text engineering framework to build an extendable and portable IE-based summarisation system
AS '02 Proceedings of the ACL-02 Workshop on Automatic Summarization - Volume 4
Measuring user acceptability of machine translations to diagnose system errors: an experience report
COLING-MTIA '02 Proceedings of the 2002 COLING workshop on Machine translation in Asia - Volume 16
Summarization: (1) using MMR for diversity - based reranking and (2) evaluating summaries
TIPSTER '98 Proceedings of a workshop on held at Baltimore, Maryland: October 13-15, 1998
Computational Linguistics
The Knowledge Engineering Review
Journal of Biomedical Informatics - Special issue: Dialog systems for health communications
Proceedings of the 7th ACM/IEEE-CS joint conference on Digital libraries
Supervised automatic evaluation for summarization with voted regression model
Information Processing and Management: an International Journal
User-model based personalized summarization
Information Processing and Management: an International Journal
Automatic multidocument summarization of research abstracts: Design and user evaluation
Journal of the American Society for Information Science and Technology
Computational Linguistics
Learning query-biased web page summarization
Proceedings of the sixteenth ACM conference on Conference on information and knowledge management
Journal of the American Society for Information Science and Technology
Information retrieval and digital libraries: lessons of research
Proceedings of the 2006 international workshop on Research issues in digital libraries
An Efficient Statistical Approach for Automatic Organic Chemistry Summarization
GoTAL '08 Proceedings of the 6th international conference on Advances in Natural Language Processing
Correlation between ROUGE and human evaluation of extractive meeting summaries
HLT-Short '08 Proceedings of the 46th Annual Meeting of the Association for Computational Linguistics on Human Language Technologies: Short Papers
Is text-to-speech synthesis ready for use in computer-assisted language learning?
Speech Communication
Extrinsic summarization evaluation: A decision audit task
ACM Transactions on Speech and Language Processing (TSLP)
When is an embedded MT system "good enough" for filtering?
EmbedMT '00 ANLP-NAACL 2000 Workshop: Embedded Machine Translation Systems
NP animacy identification for anaphora resolution
Journal of Artificial Intelligence Research
Reuse and challenges in evaluating language generation systems: position paper
Evalinitiatives '03 Proceedings of the EACL 2003 Workshop on Evaluation Initiatives in Natural Language Processing: are evaluation methods, metrics and resources reusable?
Evalinitiatives '03 Proceedings of the EACL 2003 Workshop on Evaluation Initiatives in Natural Language Processing: are evaluation methods, metrics and resources reusable?
Shared-task evaluations in HLT: lessons for NLG
INLG '06 Proceedings of the Fourth International Natural Language Generation Conference
Improving legal information retrieval using an ontological framework
Artificial Intelligence and Law
Work-in-progress project report: CESTA - machine translation evaluation campaign
LRTWRT '04 Proceedings of the Second International Workshop on Language Resources for Translation Work, Research and Training
Summarizing web sites automatically
AI'03 Proceedings of the 16th Canadian society for computational studies of intelligence conference on Advances in artificial intelligence
Chinese text automatic summarization based on affinity propagation cluster
FSKD'09 Proceedings of the 6th international conference on Fuzzy systems and knowledge discovery - Volume 1
Exploring correlation between ROUGE and human evaluation on meeting summaries
IEEE Transactions on Audio, Speech, and Language Processing
INLG '10 Proceedings of the 6th International Natural Language Generation Conference
Towards an extrinsic evaluation of referring expressions in situated dialogs
INLG '10 Proceedings of the 6th International Natural Language Generation Conference
Introducing shared tasks to NLG: the TUNA shared task evaluation challenges
Empirical methods in natural language generation
Multilingual summarization evaluation without human models
COLING '10 Proceedings of the 23rd International Conference on Computational Linguistics: Posters
Text summarisation in progress: a literature review
Artificial Intelligence Review
How we BLESSed distributional semantic evaluation
GEMS '11 Proceedings of the GEMS 2011 Workshop on GEometrical Models of Natural Language Semantics
GEMS: generative modeling for evaluation of summaries
CICLing'10 Proceedings of the 11th international conference on Computational Linguistics and Intelligent Text Processing
Evaluating web search result summaries
ECIR'06 Proceedings of the 28th European conference on Advances in Information Retrieval
WNavis: Navigating Wikipedia semantically with an SNA-based summarization technique
Decision Support Systems
A genetic graph-based clustering approach to biomedical summarization
Proceedings of the 3rd International Conference on Web Intelligence, Mining and Semantics
MICAI'12 Proceedings of the 11th Mexican international conference on Advances in Computational Intelligence - Volume Part II
A task-performance evaluation of referring expressions in situated collaborative task dialogues
Language Resources and Evaluation
Hi-index | 0.00 |
From the Publisher:This comprehensive state-of-the-art book is the first devoted to the important and timely issue of evaluating NLP systems. It addresses the whole area of NLP system evaluation, including aims and scope, problems and methodology. The authors provide a wide-ranging and careful analysis of evaluation concepts, reinforced with extensive illustrations; they relate systems to their environments and develop a framework for proper evaluation. The discussion of principles is completed by a detailed review of practice and strategies in the field, covering both systems for specific tasks, like translation, and core language processors. The methodology lessons drawn from the analysis and review are applied in a series of example cases. The book also refers NLP system evaluation to the neighbouring areas of information and speech processing, and addresses issues of tool and data provision for evaluation. A comprehensive bibliography and subject index are included as well as a term glossary. This monograph will be a valuable source of inspiration in research, practice, and teaching.