The freshness of web search engine databases

Authors:
Dirk Lewandowski;Henry Wahlig;Gunnar Meyer-Bautor
Affiliations:
-;-;Department of Information Science, Heinrich-Heine-University Düsseldorf, Germany
Venue:
Journal of Information Science
Year:
2006

Citing 7
Cited 11

First 20 precision among World Wide Web search services (search engines)

Journal of the American Society for Information Science
Accessibility of information on the Web

intelligence
A case study in web search using TREC algorithms

Proceedings of the 10th international conference on World Wide Web
Assessing bias in search engines

Information Processing and Management: an International Journal
What's new on the web?: the evolution of the web from a search engine perspective

Proceedings of the 13th international conference on World Wide Web
Search engine coverage bias: evidence and possible causes

Information Processing and Management: an International Journal
Web-crawling reliability

Journal of the American Society for Information Science and Technology - Special issue: Webometrics

Lazy preservation: reconstructing websites by crawling the crawlers

WIDM '06 Proceedings of the 8th annual ACM international workshop on Web information and data management
Web searching, search engines and Information Retrieval

Information Services and Use
Combining text and link analysis for focused crawling-An application for vertical search engines

Information Systems
Quantitative comparisons of search engine results

Journal of the American Society for Information Science and Technology
A three-year study on the freshness of web search engine databases

Journal of Information Science
What users see - Structures in search engine results pages

Information Sciences: an International Journal
A practical method for browsing a relational database using a standard search engine

Integrated Computer-Aided Engineering - Selected papers from the IEEE Conference on Information Reuse and Integration (IRI), July 13-15, 2008
Google stemming mechanisms

Journal of Information Science
Estimating evolution of freshness in Internet cache directories under the capture-recapture methodology

Computer Networks: The International Journal of Computer and Telecommunications Networking
Coverage and timeliness analysis of search engines with webpage monitoring results

WISE'07 Proceedings of the 8th international conference on Web information systems engineering
U.S. academic libraries: understanding their web presence and their relationship with economic indicators

Scientometrics

Quantified Score

Hi-index	0.00

Visualization

Abstract

This study measures the frequency with which search engines update their indices. Therefore, 38 websites that are updated on a daily basis were analysed within a time-span of six weeks. The analysed search engines were Google, Yahoo and MSN. We find that Google performs best overall with the most pages updated on a daily basis, but only MSN is able to update all pages within a time-span of less than 20 days. Both other engines have outliers that are older. In terms of indexing patterns, we find different approaches at the different engines. While MSN shows clear update patterns, Google shows some outliers and the update process of the Yahoo index seems to be quite chaotic. Implications are that the quality of different search engine indices varies and more than one engine should be used when searching for current content.