Testing the Predictive Power of Variable History Web Usage

  • Authors:
  • José Borges;Mark Levene

  • Affiliations:
  • University of Porto, School of Engineering, R. Dr. Roberto Frias, 4200-465, Porto, Portugal;University of London, School of Computer Science and Information Systems, Birkbeck, Malet Street, WC1E 7HX, London, UK

  • Venue:
  • Soft Computing - A Fusion of Foundations, Methodologies and Applications - Web intelligence and change discovery
  • Year:
  • 2007

Quantified Score

Hi-index 0.01

Visualization

Abstract

We present two methods for testing the predictive power of a variable length Markov chain induced from a collection of user web navigation sessions. The collection of sessions is split into a training and a test set. The first method uses a χ2 statistical test to measure the significance of the distance between the distribution of the probabilities assigned to the test trails by a Markov model build from the full collection of sessions and a model built from the training set. The statistical test measures the ability of the model to generalise its predictions to the unseen sessions from the test set. The second method evaluates the model ability to predict the last page of a navigation session based on the preceding pages viewed by recording the mean absolute error of the rank of the last occurring page among the predictions provided by the model. Experimental results conducted on both real and random data sets are reported and the results show that in most cases a second-order model is able to capture sufficient history to predict the next link choice with high accuracy.