MURAX: a robust linguistic approach for question answering using an on-line encyclopedia
SIGIR '93 Proceedings of the 16th annual international ACM SIGIR conference on Research and development in information retrieval
Overview of the sixth text REtrieval conference (TREC-6)
Information Processing and Management: an International Journal - The sixth text REtrieval conference (TREC-6)
Building a question answering test collection
SIGIR '00 Proceedings of the 23rd annual international ACM SIGIR conference on Research and development in information retrieval
Variations in relevance judgments and the measurement of retrieval effectiveness
Information Processing and Management: an International Journal
Question Answering from Frequently Asked Question Files: Experiences with the FAQ Finder System
Question Answering from Frequently Asked Question Files: Experiences with the FAQ Finder System
BEN: description of the PLUM system as used for MUC-6
MUC6 '95 Proceedings of the 6th conference on Message understanding
SRI International FASTUS system: MUC-6 test results and analysis
MUC6 '95 Proceedings of the 6th conference on Message understanding
Proceedings of the tenth international conference on Information and knowledge management
ExtrAns: Extracting Answers from Technical Texts
IEEE Intelligent Systems
Evaluating answers to definition questions
NAACL-Short '03 Proceedings of the 2003 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology: companion volume of the Proceedings of HLT-NAACL 2003--short papers - Volume 2
ACM Transactions on Asian Language Information Processing (TALIP)
Building a reusable test collection for question answering
Journal of the American Society for Information Science and Technology - Research Articles
Learning to identify single-snippet answers to definition questions
COLING '04 Proceedings of the 20th international conference on Computational Linguistics
Journal of the American Society for Information Science and Technology
Question Answering in Restricted Domains: An Overview
Computational Linguistics
Patterns of semantic relations to improve image content search
Web Semantics: Science, Services and Agents on the World Wide Web
Natural language processing in clime, a multilingual legal advisory system†
Natural Language Engineering
A framework of a logic-based question-answering system for the medical domain (LOQAS-Med)
Proceedings of the 2009 ACM symposium on Applied Computing
Question answering based on pervasive agent ontology and Semantic Web
Knowledge-Based Systems
A classification-based approach to question answering in discussion boards
Proceedings of the 32nd international ACM SIGIR conference on Research and development in information retrieval
Intrinsic versus extrinsic evaluations of parsing systems
Evalinitiatives '03 Proceedings of the EACL 2003 Workshop on Evaluation Initiatives in Natural Language Processing: are evaluation methods, metrics and resources reusable?
Socializing or knowledge sharing?: characterizing social intent in community question answering
Proceedings of the 18th ACM conference on Information and knowledge management
Learning of graph-based question answering rules
TextGraphs-1 Proceedings of the First Workshop on Graph Based Methods for Natural Language Processing
Finding short definitions of terms on web pages
EMNLP '09 Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing: Volume 3 - Volume 3
Question answering system based on ontology and semantic web
RSKT'08 Proceedings of the 3rd international conference on Rough sets and knowledge technology
Biomedical question answering: A survey
Computer Methods and Programs in Biomedicine
ACM SIGIR Forum
A study on the use of search engines for answering clinical questions
HIKM '10 Proceedings of the Fourth Australasian Workshop on Health Informatics and Knowledge Management - Volume 108
Object search: supporting structured queries in web search engines
SS '10 Proceedings of the NAACL HLT 2010 Workshop on Semantic Search
Mining name translations from entity graph mapping
EMNLP '10 Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing
INEX'09 Proceedings of the Focused retrieval and evaluation, and 8th international conference on Initiative for the evaluation of XML retrieval
INEX'09 Proceedings of the Focused retrieval and evaluation, and 8th international conference on Initiative for the evaluation of XML retrieval
Chinese question retrieval system using dependency information
AMT'10 Proceedings of the 6th international conference on Active media technology
A survey of paraphrasing and textual entailment methods
Journal of Artificial Intelligence Research
SocialSearch: enhancing entity search with social network matching
Proceedings of the 14th International Conference on Extending Database Technology
Biometric animal databases from field photographs: identification of individual zebra in the wild
Proceedings of the 1st ACM International Conference on Multimedia Retrieval
Question classification for a Croatian QA system
TSD'11 Proceedings of the 14th international conference on Text, speech and dialogue
OUC's participation in the 2010 INEX book track
INEX'10 Proceedings of the 9th international conference on Initiative for the evaluation of XML retrieval: comparative evaluation of focused retrieval
Mining entity translations from comparable corpora: a holistic graph mapping approach
Proceedings of the 20th ACM international conference on Information and knowledge management
Hypotheses selection criteria in a reranking framework for spoken language understanding
EMNLP '11 Proceedings of the Conference on Empirical Methods in Natural Language Processing
An ontology for clinical questions about the contents of patient notes
Journal of Biomedical Informatics
Efficient Graph Kernels for Textual Entailment Recognition
Fundamenta Informaticae - RCRA 2009 Experimental Evaluation of Algorithms for Solving Problems with Combinatorial Explosion
Generic subset ranking using binary classifiers
Theoretical Computer Science
Efficient Entity Translation Mining: A Parallelized Graph Alignment Approach
ACM Transactions on Information Systems (TOIS)
Reinforcement learning of question-answering dialogue policies for virtual museum guides
SIGDIAL '12 Proceedings of the 13th Annual Meeting of the Special Interest Group on Discourse and Dialogue
A high-performance FAQ retrieval method using minimal differentiator expressions
Knowledge-Based Systems
Machine learning of syntactic parse trees for search and classification of text
Engineering Applications of Artificial Intelligence
A cloud of FAQ: A highly-precise FAQ retrieval system for the Web 2.0
Knowledge-Based Systems
Hi-index | 0.00 |
The Text REtrieval Conference (TREC) question answering track is an effort to bring the benefits of large-scale evaluation to bear on a question answering (QA) task. The track has run twice so far, first in TREC-8 and again in TREC-9. In each case, the goal was to retrieve small snippets of text that contain the actual answer to a question rather than the document lists traditionally returned by text retrieval systems. The best performing systems were able to answer about 70% of the questions in TREC-8 and about 65% of the questions in TREC-9. While the 65% score is a slightly worse result than the TREC-8 scores in absolute terms, it represents a very significant improvement in question answering systems. The TREC-9 task was considerably harder than the TREC-8 task because TREC-9 used actual users’ questions while TREC-8 used questions constructed for the track. Future tracks will continue to challenge the QA community with more difficult, and more realistic, question answering tasks.