Data mining of search engine logs

  • Authors:
  • Martin Whittle;Barry Eaglestone;Nigel Ford;Valerie J. Gillet;Andrew Madden

  • Affiliations:
  • Department of Information Studies, University of Sheffield, UK;Department of Information Studies, University of Sheffield, UK;Department of Information Studies, University of Sheffield, UK;Department of Information Studies, University of Sheffield, UK;Department of Information Studies, University of Sheffield, UK

  • Venue:
  • Journal of the American Society for Information Science and Technology
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

This article reports on the development of a novel method for the analysis of Web logs. The method uses techniques that look for similarities between queries and identify sequences of “query transformation”. It allows sequences of query transformations to be represented as graphical networks, thereby giving a richer view of search behavior than is possible with the usual sequential descriptions. We also perform a basic analysis to study the correlations between observed transformation codes, with results that appear to show evidence of behavior habits. The method was developed using transaction logs from the Excite search engine to provide a tool for an ongoing research project that is endeavoring to develop a greater understanding of Web-based searching by the general public. © 2007 Wiley Periodicals, Inc.