Using statistical testing in the evaluation of retrieval experiments
SIGIR '93 Proceedings of the 16th annual international ACM SIGIR conference on Research and development in information retrieval
A hidden Markov model information retrieval system
Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval
Experiments in multi-modal automatic content extraction
HLT '01 Proceedings of the first international conference on Human language technology research
Producing biographical summaries: combining linguistic knowledge with corpus statistics
ACL '01 Proceedings of the 39th Annual Meeting on Association for Computational Linguistics
BLEU: a method for automatic evaluation of machine translation
ACL '02 Proceedings of the 40th Annual Meeting on Association for Computational Linguistics
Automatic evaluation of summaries using N-gram co-occurrence statistics
NAACL '03 Proceedings of the 2003 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology - Volume 1
NAACL-ANLP-AutoSum '00 Proceedings of the 2000 NAACL-ANLPWorkshop on Automatic summarization - Volume 4
Generic soft pattern models for definitional question answering
Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval
A supervised learning approach to search of definitions
Journal of Computer Science and Technology - Special section on China AVS standard
HLT '05 Proceedings of the conference on Human Language Technology and Empirical Methods in Natural Language Processing
HLT '05 Proceedings of the conference on Human Language Technology and Empirical Methods in Natural Language Processing
Automatically evaluating answers to definition questions
HLT '05 Proceedings of the conference on Human Language Technology and Empirical Methods in Natural Language Processing
Soft pattern matching models for definitional question answering
ACM Transactions on Information Systems (TOIS)
Information Processing and Management: an International Journal - Special issue: AIRS2005: Information retrieval research in Asia
Object identification and retrieval from efficient image matching. Snap2Tell with the STOIC dataset
Information Processing and Management: an International Journal - Special issue: AIRS2005: Information retrieval research in Asia
The role of information retrieval in answering complex questions
COLING-ACL '06 Proceedings of the COLING/ACL on Main conference poster sessions
A system for understanding imaged infographics and its applications
Proceedings of the 2007 ACM symposium on Document engineering
Learning to rank definitions to generate quizzes for interactive information presentation
ACL '07 Proceedings of the 45th Annual Meeting of the ACL on Interactive Poster and Demonstration Sessions
Qualitative dimensions in question answering: extending the definitional QA task
AAAI'05 Proceedings of the 20th national conference on Artificial intelligence - Volume 4
Finding short definitions of terms on web pages
EMNLP '09 Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing: Volume 3 - Volume 3
Object identification and retrieval from efficient image matching: Snap2Tell with the STOIC dataset
AIRS'05 Proceedings of the Second Asia conference on Asia Information Retrieval Technology
Phrase-based definitional question answering using definition terminology
AIRS'05 Proceedings of the Second Asia conference on Asia Information Retrieval Technology
| Hi-index | 0.00 |
This paper evaluates an extraction-based approach to answering definitional questions. Our system extracted useful linguistic constructs called linguistic features from raw text using information extraction tools and formulated answers based on such features. The features employed include appositives, copulas, structured patterns, relations, propositions and raw sentences. The features were ranked based on feature type and similarity to a question profile. Redundant features were detected using a simple heuristic-based strategy. The approach achieved state of the art performance at the TREC 2003 QA evaluation. Component analysis of the system was carried out using an automatic scoring function called Rouge (Lin and Hovy, 2003). Major findings include 1) answers using linguistic features are significantly better than those using raw sentences; 2) the most useful features are appositives and copulas; 3) question profiles, as a means of modeling user interests, can significantly improve system performance; 4) the Rouge scores are closely correlated with subjective evaluation results, indicating the suitability of using Rouge for evaluating definitional QA systems.