A Topic-Specific Web Crawler with Concept Similarity Context Graph Based on FCA

Authors:
Yuekui Yang;Yajun Du;Jingyu Sun;Yufeng Hai
Affiliations:
School of Mathematical and Computers Science, Xihua University, Chengdu, China 610039;School of Mathematical and Computers Science, Xihua University, Chengdu, China 610039;College of Computer and Software, Taiyuan University of Technology, Taiyuan, China 030024;School of Mathematical and Computers Science, Xihua University, Chengdu, China 610039
Venue:
ICIC '08 Proceedings of the 4th international conference on Intelligent Computing: Advanced Intelligent Computing Theories and Applications - with Aspects of Artificial Intelligence
Year:
2008

Citing 8
Cited 4

Focused crawling: a new approach to topic-specific Web resource discovery

WWW '99 Proceedings of the eighth international conference on World Wide Web
Formal Concept Analysis: Mathematical Foundations

Formal Concept Analysis: Mathematical Foundations
An Approach for Measuring Semantic Similarity between Words Using Multiple Information Sources

IEEE Transactions on Knowledge and Data Engineering
Learnable topic-specific web crawler

Journal of Network and Computer Applications - Special issue on computational intelligence on the internet
The indexable web is more than 11.5 billion pages

WWW '05 Special interest tracks and posters of the 14th international conference on World Wide Web
Combining text and link analysis for focused crawling-An application for vertical search engines

Information Systems
Topic-specific crawling on the Web with the measurements of the relevancy context graph

Information Systems
Ontology-based concept similarity in Formal Concept Analysis

Information Sciences: an International Journal

Formal concept analysis in knowledge discovery: a survey

ICCS'10 Proceedings of the 18th international conference on Conceptual structures: from information to intelligence
Semantic ranking of web pages based on formal concept analysis

Journal of Systems and Software
Review: Formal concept analysis in knowledge processing: A survey on applications

Expert Systems with Applications: An International Journal
Formal concept analysis approach for data extraction from a limited deep web database

Journal of Intelligent Information Systems

Quantified Score

Hi-index	0.00

Visualization

Abstract

With Internet growing exponentially, topic-specific web crawler is becoming more and more popular in the web data mining. How to order the unvisited URLs was studied deeply, we present the notion of concept similarity context graph, and propose a novel approach to topic-specific web crawler, which calculates the unvisited URLs' prediction score by concepts' similarity in Formal Concept Analysis (FCA), while improving the retrieval precision and recall ratio. We firstly build a concept lattice using the visited pages, extract the core concepts which reflect the user's query topic from the concept lattice, and then construct our concept similarity context graph based on the semantic similarities between the core concepts and other concepts.