OntoCrawler: A focused crawler with ontology-supported website models for information agents

  • Authors:

  • Sheng-Yuan Yang

  • Affiliations:

  • Department of Computer and Communication Engineering, St. John's University, Taipei, 499, Sec. 4, TamKing Rd., Tamsui, Taipei County 25135, Taiwan, ROC

  • Venue:
  • Expert Systems with Applications: An International Journal
  • Year:
  • 2010

Quantified Score

Hi-index 12.05

Visualization

Abstract

This paper proposed the use of ontology-supported website models to provide a semantic level solution for an information agent so that it can provide fast, precise, and stable query results. We have based on the technique to develop a focused crawler, namely, OntoCrawler which can benefit both user requests and domain semantics. The technique in this research has practically applied on Google and Yahoo searching engines to actively search for webpages of related information, and the experiment outcomes indicated that this technique could definitely up-rise precision rate and recall rate of webpage query. Equipped with this technique, we have developed an ontology-supported information agent shell in Scholar domain which manifests the following interesting features: ontology-supported construction of website models, website models-supported website model expansion, website models-supported webpage retrieval, high-level outcomes of information recommendation, and accordingly proved the feasibility of the related techniques proposed in this paper.