Web Structure in 2005

  • Authors:
  • Yu Hirate;Shin Kato;Hayato Yamana

  • Affiliations:
  • Dept. of Computer Science, Waseda University, Tokyo, Japan;Dept. of Computer Science, Waseda University, Tokyo, Japan;Dept. of Computer Science, Waseda University, Tokyo, Japan

  • Venue:
  • Algorithms and Models for the Web-Graph
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

The estimated number of static web pages in Oct 2005 was over 20.3 billion, which was determined by multiplying the average number of pages per web server based on the results of three previous studies, 200 pages, by the estimated number of web servers on the Internet, 101.4 million. However, based on the analysis of 8.5 billion web pages that we crawled by Oct. 2005, we estimate the total number of web pages to be 53.7 billion. This is because the number of dynamic web pages has increased rapidly in recent years. We also analyzed the web structure using 3 billion of the 8.5 billion web pages that we have crawled. Our results indicate that the size of the "CORE," the central component of the bow tie structure, has increased in recent years, especially in the Chinese and Japanese web.