Importance of HTML structural elements and metadata in automated subject classification

  • Authors:
  • Koraljka Golub;Anders Ardö

  • Affiliations:
  • Knowledge Discovery and Digital Library Research Group (KnowLib), Digital Information Systems, Department of Information Technology, Lund University, Lund, Sweden;Knowledge Discovery and Digital Library Research Group (KnowLib), Digital Information Systems, Department of Information Technology, Lund University, Lund, Sweden

  • Venue:
  • ECDL'05 Proceedings of the 9th European conference on Research and Advanced Technology for Digital Libraries
  • Year:
  • 2005

Quantified Score

Hi-index 0.00

Visualization

Abstract

The aim of the study was to determine how significance indicators assigned to different Web page elements (internal metadata, title, headings, and main text) influence automated classification. The data collection that was used comprised 1000 Web pages in engineering, to which Engineering Information classes had been manually assigned. The significance indicators were derived using several different methods: (total and partial) precision and recall, semantic distance and multiple regression. It was shown that for best results all the elements have to be included in the classification process. The exact way of combining the significance indicators turned out not to be overly important: using the F1 measure, the best combination of significance indicators yielded no more than 3% higher performance results than the baseline.