Redundancy-driven web data extraction and integration

  • Authors:
  • Lorenzo Blanco;Mirko Bronzi;Valter Crescenzi;Paolo Merialdo;Paolo Papotti

  • Affiliations:
  • Università degli Studi Roma Tre;Università degli Studi Roma Tre;Università degli Studi Roma Tre;Università degli Studi Roma Tre;Università degli Studi Roma Tre

  • Venue:
  • Procceedings of the 13th International Workshop on the Web and Databases
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

A large number of web sites publish pages containing structured information about recognizable concepts, but these data are only partially used by current applications. Although such information is spread across a myriad of sources, the web scale implies a relevant redundancy. We present a domain independent system that exploits the redundancy of information to automatically extract and integrate data from the Web. Our solution concentrates on sources that provide structured data about multiple instances from the same conceptual domain, e.g., financial data, product information. Our proposal is based on an original approach that exploits the mutual dependency between the data extraction and the data integration tasks. Experiments on a sample of 175,000 pages confirm the feasibility and quality of the approach.