Filtering and Sophisticated Data Processing for Web Information Gathering

Authors:
Yuefeng Li;Ning Zhong;Xujuan Zhou;Sheng-Tang Wu
Affiliations:
School of Software Engineering and Data Communications, Queensland University of Technology, Brisbane, QLD 4001, Australia;Department of Information Engineering, Maebashi Institute of Technology, 460-1 Kamisadori-Cho, Maebashi-City 371-0816, Japan;School of Software Engineering and Data Communications, Queensland University of Technology, Brisbane, QLD 4001, Australia;School of Software Engineering and Data Communications, Queensland University of Technology, Brisbane, QLD 4001, Australia
Venue:
RSEISP '07 Proceedings of the international conference on Rough Sets and Intelligent Systems Paradigms
Year:
2007

Citing 17
Cited 0

Data mining and the Web: past, present and future

Proceedings of the 2nd international workshop on Web information and data management
Information retrieval and artificial intelligence

Artificial Intelligence - Special issue on applications of artificial intelligence
Modern Information Retrieval

Modern Information Retrieval
Enabling Concept-Based Relevance Feedback for Information Retrieval on the WWW

IEEE Transactions on Knowledge and Data Engineering
Mining Sequential Patterns

ICDE '95 Proceedings of the Eleventh International Conference on Data Engineering
Research Issues in Web Data Mining

DaWaK '99 Proceedings of the First International Conference on Data Warehousing and Knowledge Discovery
Integrating Web Usage and Content Mining for More Effective Personalization

EC-WEB '00 Proceedings of the First International Conference on Electronic Commerce and Web Technologies
Phrase-based Document Similarity Based on an Index Graph Model

ICDM '02 Proceedings of the 2002 IEEE International Conference on Data Mining
Web usage mining: discovery and applications of usage patterns from Web data

ACM SIGKDD Explorations Newsletter
Interpretations of Association Rules by Granular Computing

ICDM '03 Proceedings of the Third IEEE International Conference on Data Mining
Automatic Pattern-Taxonomy Extraction for Web Mining

WI '04 Proceedings of the 2004 IEEE/WIC/ACM International Conference on Web Intelligence
Mining Ontology for Automatically Acquiring Web User Information Needs

IEEE Transactions on Knowledge and Data Engineering
Multi-Tier Granule Mining for Representations of Multidimensional Association Rules

ICDM '06 Proceedings of the Sixth International Conference on Data Mining
Deploying Approaches for Pattern Refinement in Text Mining

ICDM '06 Proceedings of the Sixth International Conference on Data Mining
Rough Association Rule Mining in Text Documents for Acquiring Web User Information Needs

WI '06 Proceedings of the 2006 IEEE/WIC/ACM International Conference on Web Intelligence
Mining rough association from text documents

RSCTC'06 Proceedings of the 5th international conference on Rough Sets and Current Trends in Computing
Web mining in soft computing framework: relevance, state of the art and future directions

IEEE Transactions on Neural Networks

Quantified Score

Hi-index	0.00

Visualization

Abstract

Mismatch and overload are two fundamental issues regarding the efficiency of Web information gathering. To provide a satisfactory solution, this paper presents a Web information gathering system that encapsulates two phases: the filtering and sophisticated data processing. The objective of the filtering is to quickly filter out most irrelevant data in order to avoid mismatch. The phase of the sophisticated data processing can use more sophisticated techniques without carefully considering time complexities. The second phase is for solving the problem of the information overload.