SemGen: towards a semantic data generator for benchmarking duplicate detectors

  • Authors:
  • Wolfgang Gottesheim;Stefan Mitsch;Werner Retschitzegger;Wieland Schwinger;Norbert Baumgartner

  • Affiliations:
  • Johannes Kepler University Linz, Linz, Austria;Johannes Kepler University Linz, Linz, Austria;Johannes Kepler University Linz, Linz, Austria;Johannes Kepler University Linz, Linz, Austria;team Communication Technology Mgt. Ltd., Vienna, Austria

  • Venue:
  • DASFAA'11 Proceedings of the 16th international conference on Database systems for advanced applications
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

Benchmarking the quality of duplicate detection methods requires comprehensive knowledge on duplicate pairs in addition to sufficient size and variability of test data sets. While extending real-world data sets with artificially created data is promising, current approaches to such synthetic data generation, however, work solely on a quantitative level, which entails that duplicate semantics are only implicitly represented, leading to only insufficiently configurable variability. In this paper we propose SemGen, a semantics-driven approach to synthetic data generation. SemGen first diversifies real-world objects on a qualitative level, before in a second step quantitative values are generated. To demonstrate the applicability of SemGen, we propose how to define duplicate semantics for the domain of road traffic management. A discussion of lessons learned concludes the paper.