Extracting general lists from web documents: a hybrid approach

  • Authors:

  • Fabio Fumarola;Tim Weninger;Rick Barber;Donato Malerba;Jiawei Han

  • Affiliations:

  • Dipartimento di Informatica, Università degli Studi di Bari "Aldo Moro", Bari, Italy;Computer Science Department, University of Illinois at Urbana-Champaign, Urbana-Champaign, IL;Computer Science Department, University of Illinois at Urbana-Champaign, Urbana-Champaign, IL;Dipartimento di Informatica, Università degli Studi di Bari "Aldo Moro", Bari, Italy;Computer Science Department, University of Illinois at Urbana-Champaign, Urbana-Champaign, IL

  • Venue:
  • IEA/AIE'11 Proceedings of the 24th international conference on Industrial engineering and other applications of applied intelligent systems conference on Modern approaches in applied intelligence - Volume Part I
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

The problem of extracting structured data (i.e. lists, record sets, tables, etc.) from the Web has been traditionally approached by taking into account either the underlying markup structure of a Web page or the visual structure of the Web page. However, empirical results show that considering the HTML structure and visual cues of a Web page independently do not generalize well. We propose a new hybrid method to extract general lists from the Web. It employs both general assumptions on the visual rendering of lists, and the structural representation of items contained in them. We show that our method significantly outperforms existing methods across a varied Web corpus.