Evaluation of the NSDL and google for obtaining pedagogical resources

Authors:
Frank McCown;Johan Bollen;Michael L. Nelson
Affiliations:
Computer Science Department, Old Dominion University, Norfolk, VA;Computer Science Department, Old Dominion University, Norfolk, VA;Computer Science Department, Old Dominion University, Norfolk, VA
Venue:
ECDL'05 Proceedings of the 9th European conference on Research and Advanced Technology for Digital Libraries
Year:
2005

Citing 12
Cited 4

Finding information on the World Wide Web: the retrieval effectiveness of search engines

Information Processing and Management: an International Journal
First 20 precision among World Wide Web search services (search engines)

Journal of the American Society for Information Science
Searching the Web: the public and their queries

Journal of the American Society for Information Science and Technology
Methods for measuring search engine performance over time

Journal of the American Society for Information Science and Technology
Core services in the architecture of the national science digital library (NSDL)

Proceedings of the 2nd ACM/IEEE-CS joint conference on Digital libraries
Collection synthesis

Proceedings of the 2nd ACM/IEEE-CS joint conference on Digital libraries
Automatic evaluation of world wide web search services

SIGIR '02 Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval
Measuring Search Engine Quality

Information Retrieval
Focused Crawls, Tunneling, and Digital Libraries

ECDL '02 Proceedings of the 6th European Conference on Research and Advanced Technology for Digital Libraries
Understanding educator perceptions of "quality" in digital libraries

Proceedings of the 3rd ACM/IEEE-CS joint conference on Digital libraries
A comprehensive and systematic model of user evaluation of web search engines: I. theory and background

Journal of the American Society for Information Science and Technology
Automatic performance evaluation of web search engines

Information Processing and Management: an International Journal

Agreeing to disagree: search engines and their public interfaces

Proceedings of the 7th ACM/IEEE-CS joint conference on Digital libraries
The PRET A Rapporter framework: Evaluating digital libraries from the perspective of information work

Information Processing and Management: an International Journal
Comparing Google to ask-a-librarian service for answering factual and topical questions

ECDL'09 Proceedings of the 13th European conference on Research and advanced technology for digital libraries
Do graphical search interfaces support effective search for and evaluation of digital library resources

Proceedings of the 11th annual international ACM/IEEE joint conference on Digital libraries

Quantified Score

Hi-index	0.00

Visualization

Abstract

We describe an experiment that measures the pedagogical usefulness of the results returned by the National Science Digital Library (NSDL) and Google. Eleven public school teachers from the state of Virginia (USA) were used to evaluate a set of 38 search terms and search results based on the Standards of Learning (SOL) for Virginia Public Schools. Evaluations of search results were obtained from the NSDL (572 evaluations) and Google (650 evaluations). In our experiments, teachers ranked the links returned by Google as more relevant to the SOL than the links returned by the NSDL. Furthermore, Google's ranking of educational material also showed some correlation with expert judgments.