Automated information retrieval: theory and methods
Automated information retrieval: theory and methods
Question-answering by predictive annotation
SIGIR '00 Proceedings of the 23rd annual international ACM SIGIR conference on Research and development in information retrieval
Mining the web for answers to natural language questions
Proceedings of the tenth international conference on Information and knowledge management
Large scale testing of a descriptive phrase finder
HLT '01 Proceedings of the first international conference on Human language technology research
The structure and performance of an open-domain question answering system
ACL '00 Proceedings of the 38th Annual Meeting on Association for Computational Linguistics
Probabilistic question answering on the web
Proceedings of the 11th international conference on World Wide Web
Chinese question-answering system
Journal of Computer Science and Technology
Probabilistic question answering on the Web: Research Articles
Journal of the American Society for Information Science and Technology
Tapping the power of text mining
Communications of the ACM - Privacy and security in highly dynamic systems
A supervised learning approach to search of definitions
Journal of Computer Science and Technology - Special section on China AVS standard
Answering relationship queries on the web
Proceedings of the 16th international conference on World Wide Web
Applying question answering technology to locating malevolent online content
Decision Support Systems
ProTDB: probabilistic data in XML
VLDB '02 Proceedings of the 28th international conference on Very Large Data Bases
Modelling vague places with knowledge from the Web
International Journal of Geographical Information Science - Digital Gazetteer Research
Reward System for Completing FAQs
Proceedings of the 2009 conference on Artificial Intelligence Research and Development: Proceedings of the 12th International Conference of the Catalan Association for Artificial Intelligence
Reward System for Completing FAQs
Proceedings of the 2009 conference on Artificial Intelligence Research and Development: Proceedings of the 12th International Conference of the Catalan Association for Artificial Intelligence
Intelligent answering location questions from the web using molecular alignment
Journal of Intelligent Information Systems
An overview of Web search evaluation methods
Computers and Electrical Engineering
Hi-index | 0.00 |
Seven hundred natural language questions from TREC-8 and TREC-9 were sent by Radev, Libner, and Fan to each of nine web search engines. The top 40 sites returned by each system were stored for evaluation of their productivity of correct answers. Each question per engine was scored as the sum of the reciprocal ranks of identified correct answers. The large number of zero scores gave a positive skew violating the normality assumption for ANOVA, so values were transformed to zero for no hit and one for one or more hits. The non-zero values were then square-root transformed to remove the remaining positive skew. Interactions were observed between search engine and answer type (name, place, date, et cetera), search engine and number of proper nouns in the query, search engine and the need for time limitation, and search engine and total query words. All effects were significant. Shortest queries had the highest mean scores. One or more proper nouns present provides a significant advantage. Non-time dependent queries have an advantage. Place, name, person, and text description had mean scores between .85 and .9 with date at .81 and number at .59. There were significant differences in score by search engine. Search engines found at least one correct answer in between 87.7 and 75.45 of the cases. Google and Northern Light were just short of a 90% hit rate. No evidence indicated that a particular engine was better at answering any particular sort of question.