New Techniques for the Discovery of Logical Documents in Web

  • Authors:
  • Keishi Tajima;Katsumi Tanaka

  • Affiliations:
  • -;-

  • Venue:
  • DANTE '99 Proceedings of the 1999 International Symposium on Database Applications in Non-Traditional Environments
  • Year:
  • 1999

Quantified Score

Hi-index 0.00

Visualization

Abstract

We propose a method of identifying logical documents in Web data. Pages in Web data are sometimes designed for presentation and do not always reflect logical structure, while a logical document is a data unit representing logical structure. One logical document often corresponds to a connected subgraph consisting of multiple pages. Therefore, for various Web data processing that should capture logical structure, such as querying facilities, extended support for user navigation, and Web structure analysis, logical documents are more appropriate data units than pages. We develop a method of identifying such logical documents in existing Web data. Our method uses three kind of information: link structure, directory structure embedded in URIs, and page contents.