Conditional Dependencies: A Principled Approach to Improving Data Quality

  • Authors:
  • Wenfei Fan;Floris Geerts;Xibei Jia

  • Affiliations:
  • University of Edinburgh and Bell Laboratories,;University of Edinburgh,;University of Edinburgh,

  • Venue:
  • BNCOD 26 Proceedings of the 26th British National Conference on Databases: Dataspace: The Final Frontier
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

Real-life data is often dirty and costs billions of pounds to businesses worldwide each year. This paper presents a promising approach to improving data quality. It effectively detects and fixes inconsistencies in real-life data based on conditional dependencies, an extension of database dependencies by enforcing bindings of semantically related data values. It accurately identifies records from unreliable data sources by leveraging relative candidate keys, an extension of keys for relations by supporting similarity and matching operators across relations. In contrast to traditional dependencies that were developed for improving the quality of schema, the revised constraints are proposed to improve the quality of data. These constraints yield practical techniques for data repairing and record matching in a uniform framework.