Semantic Web search based on ontological conjunctive queries
Web Semantics: Science, Services and Agents on the World Wide Web
Visual oXPath: robust wrapping by example
Proceedings of the 21st international conference companion on World Wide Web
Turn the page: automated traversal of paginated websites
ICWE'12 Proceedings of the 12th international conference on Web Engineering
WebSelF: a web scraping framework
ICWE'12 Proceedings of the 12th international conference on Web Engineering
Ontology-based semantic search on the Web and its combination with the power of inductive reasoning
Annals of Mathematics and Artificial Intelligence
Hi-index | 0.00 |
An effective solution to automate information extraction from Web pages is represented by wrappers. A wrapper associates a Web page with an XML document that represents part of the information in that page in a machine-readable format. Most existing wrapping approaches have traditionally focused on how to generate extraction rules, while they have ignored potential benefits deriving from the use of the schema of the information being extracted in the wrapper evaluation. In this paper, we investigate how the schema of extracted information can be effectively used in both the design and evaluation of a Web wrapper. We define a clean declarative semantics for schema-based wrappers by introducing the notion of (preferred) extraction model, which is essential to compute a valid XML document containing the information extracted from a Web page. We developed the SCRAP (SChema-based wRAPper for web data) system for the proposed schema-based wrapping approach, which also provides visual support tools to the wrapper designer. Moreover, we present a wrapper generalization framework to profitably speed up the design of schema-based wrappers. Experimental evaluation has shown that SCRAP wrappers are not only able to successfully extract the required data, but also they are robust to changes that may occur in the source Web pages.