WebPut: efficient web-based data imputation

  • Authors:
  • Zhixu Li;Mohamed A. Sharaf;Laurianne Sitbon;Shazia Sadiq;Marta Indulska;Xiaofang Zhou

  • Affiliations:
  • The University of Queensland, QLD, Australia;The University of Queensland, QLD, Australia;Queensland University of Technology, QLD, Australia;The University of Queensland, QLD, Australia;The University of Queensland, QLD, Australia;The University of Queensland, QLD, Australia

  • Venue:
  • WISE'12 Proceedings of the 13th international conference on Web Information Systems Engineering
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper, we present WebPut, a prototype system that adopts a novel web-based approach to the data imputation problem. Towards this, Webput utilizes the available information in an incomplete database in conjunction with the data consistency principle. Moreover, WebPut extends effective Information Extraction (IE) methods for the purpose of formulating web search queries that are capable of effectively retrieving missing values with high accuracy. WebPut employs a confidence-based scheme that efficiently leverages our suite of data imputation queries to automatically select the most effective imputation query for each missing value. A greedy iterative algorithm is also proposed to schedule the imputation order of the different missing values in a database, and in turn the issuing of their corresponding imputation queries, for improving the accuracy and efficiency of WebPut. Experiments based on several real-world data collections demonstrate that WebPut outperforms existing approaches.