Efficient crawling through URL ordering
WWW7 Proceedings of the seventh international conference on World Wide Web 7
Evaluating topic-driven web crawlers
Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval
An Experimental Study in Domain Engineering
EUROMICRO '07 Proceedings of the 33rd EUROMICRO Conference on Software Engineering and Advanced Applications
A New Approach to Design Domain Specific Ontology Based Web Crawler
ICIT '07 Proceedings of the 10th International Conference on Information Technology
Quality Information Retrieval for the World Wide Web
WI-IAT '08 Proceedings of the 2008 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology - Volume 01
| Hi-index | 0.00 |
As the number of Internet users and the number of accessible Web pages grows, it is becoming increasingly difficult for users to find documents that are relevant to their particular needs. Users must either browse through a large hierarchy of concepts to find the information for which they are looking or submit a query to a publicly available search engine and wade through hundreds of results, most of them irrelevant. Web crawlers are one of the most crucial components in search engines and their optimization would have a great effect on improving the searching efficiency. This paper, introduces an intelligent web crawler that uses an ontological engineering concepts for improving its crawling performance. Intelligent crawler estimates the best path for crawling. This is the first crawler that acts intelligently without any relevance feedback or training.