A technique for measuring the relative size and overlap of public Web search engines
WWW7 Proceedings of the seventh international conference on World Wide Web 7
A comparison of techniques to find mirrored hosts on the WWW
Journal of the American Society for Information Science
Spam, damn spam, and statistics: using statistical analysis to locate spam web pages
Proceedings of the 7th International Workshop on the Web and Databases: colocated with ACM SIGMOD/PODS 2004
Structured databases on the web: observations and implications
ACM SIGMOD Record
Characterizing a national community web
ACM Transactions on Internet Technology (TOIT)
Characterization of national Web domains
ACM Transactions on Internet Technology (TOIT)
On estimating the scale of national deep web
DEXA'07 Proceedings of the 18th international conference on Database and Expert Systems Applications
Databases on the web: national web domain survey
Proceedings of the 15th Symposium on International Database Engineering & Applications
Current challenges in web crawling
ICWE'13 Proceedings of the 13th international conference on Web Engineering
| Hi-index | 0.00 |
A huge portion of today's Web consists of web pages filled with information from myriads of online databases. This part of theWeb, known as the deep Web, is to date relatively unexplored and even major characteristics such as number of searchable databases on the Web or databases' subject distribution are somewhat disputable. In this paper, we revisit a problem of deep Web characterization: how to estimate the total number of online databases on the Web? We propose the Host-IP clustering sampling method to address the drawbacks of existing approaches for deep Web characterization and report our findings based on the survey of Russian Web. Obtained estimates together with a proposed sampling technique could be useful for further studies to handle data in the deep Web.