Combined mining of Web server logs and web contents for classifying user navigation patterns and predicting users' future requests

Authors:
Haibin Liu;Vlado Kešelj
Affiliations:
Faculty of Computer Science, Dalhousie University, 6050 University Ave, Halifax, NS, Canada B3H 1W5;Faculty of Computer Science, Dalhousie University, 6050 University Ave, Halifax, NS, Canada B3H 1W5
Venue:
Data & Knowledge Engineering
Year:
2007

Citing 11
Cited 19

Information filtering based on user behavior analysis and best match text retrieval

SIGIR '94 Proceedings of the 17th annual international ACM SIGIR conference on Research and development in information retrieval
Effective personalization based on association rule discovery from web usage data

Proceedings of the 3rd international workshop on Web information and data management
Predicting web actions from HTML content

Proceedings of the thirteenth ACM conference on Hypertext and hypermedia
Modern Information Retrieval

Modern Information Retrieval
Data Mining: Introductory and Advanced Topics

Data Mining: Introductory and Advanced Topics
Hybrid Recommender Systems: Survey and Experiments

User Modeling and User-Adapted Interaction
An Intelligent Web Recommendation System: A Web Usage Mining Approach

ISMIS '02 Proceedings of the 13th International Symposium on Foundations of Intelligent Systems
Eliminating noisy information in Web pages for data mining

Proceedings of the ninth ACM SIGKDD international conference on Knowledge discovery and data mining
SIGIR 2003 workshop report: implicit measures of user interests and preferences

ACM SIGIR Forum
A Framework for the Evaluation of Session Reconstruction Heuristics in Web-Usage Analysis

INFORMS Journal on Computing
Integrating web content clustering into web log association rule mining

AI'05 Proceedings of the 18th Canadian Society conference on Advances in Artificial Intelligence

Web user behaviors prediction system using trend similarity

SMO'07 Proceedings of the 7th WSEAS International Conference on Simulation, Modelling and Optimization
An efficient hierarchical clustering model for grouping web transactions

International Journal of Business Intelligence and Data Mining
Mining students' behavior in web-based learning programs

Expert Systems with Applications: An International Journal
Creating meaningful data from web logs for improving the impressiveness of a website by using path analysis method

Expert Systems with Applications: An International Journal
Application of neural networks and Kano's method to content recommendation in web personalization

Expert Systems with Applications: An International Journal
Cognitive styles and web-based instruction: field dependent/independent vs. Holist/Serialist

SMC'09 Proceedings of the 2009 IEEE international conference on Systems, Man and Cybernetics
A web page usage prediction scheme using sequence indexing and clustering techniques

Data & Knowledge Engineering
WebPUM: A Web-based recommendation system to predict user future movements

Expert Systems with Applications: An International Journal
Identifying user preferences with Wrapper-based Decision Trees

Expert Systems with Applications: An International Journal
Mining Web navigation patterns with a path traversal graph

Expert Systems with Applications: An International Journal
ARS: web page recommendation system for anonymous users based on web usage mining

ECS'10/ECCTD'10/ECCOM'10/ECCS'10 Proceedings of the European conference of systems, and European conference of circuits technology and devices, and European conference of communications, and European conference on Computer science
An analysis of collaborative patterns in large-scale ontology development projects

Proceedings of the sixth international conference on Knowledge capture
Discovering better navigation sequences for the session construction problem

Data & Knowledge Engineering
Feature evaluation for web crawler detection with data mining techniques

Expert Systems with Applications: An International Journal
A multi-agent recommender system for supporting device adaptivity in e-Commerce

Journal of Intelligent Information Systems
Ontology driven bee's foraging approach based self adaptive online recommendation system

Journal of Systems and Software
Web usage mining for analysing elder self-care behavior patterns

Expert Systems with Applications: An International Journal
Access patterns for robots and humans in web archives

Proceedings of the 13th ACM/IEEE-CS joint conference on Digital libraries
Mining cluster-based patterns for elder self-care behavior

AusDM '12 Proceedings of the Tenth Australasian Data Mining Conference - Volume 134

Quantified Score

Hi-index	0.01

Visualization

Abstract

We present a study of the automatic classification of web user navigation patterns and propose a novel approach to classifying user navigation patterns and predicting users' future requests. The approach is based on the combined mining of Web server logs and the contents of the retrieved web pages. The textual content of web pages is captured through extraction of character N-grams, which are combined with Web server log files to derive user navigation profiles. The approach is implemented as an experimental system, and its performance is evaluated based on two tasks: classification and prediction. The system achieves the classification accuracy of nearly 70% and the prediction accuracy of about 65%, which is about 20% higher than the classification accuracy by mining Web server logs alone. This approach may be used to facilitate better web personalization and website organization.