Identity matching and information acquisition: Estimation of optimal threshold parameters

Authors:
Pantea Alirezazadeh;Fidan Boylu;Robert Garfinkel;Ram Gopal;Paulo Goes
Affiliations:
Department of Operations and Information Management, University of Connecticut, United States;Department of Operations and Information Management, University of Connecticut, United States;Department of Operations and Information Management, University of Connecticut, United States;Department of Operations and Information Management, University of Connecticut, United States;Department of Management Information Systems, University of Arizona, United States
Venue:
Decision Support Systems
Year:
2014

Citing 9
Cited 0

A model of decision-making with sequential information-acquisition (part 1)

Decision Support Systems
A model of decision-making with sequential information-acquisition (part 2)

Decision Support Systems
A Probabilistic Decision Model for Entity Matching in Heterogeneous Databases

Management Science
Text Classification from Labeled and Unlabeled Documents using EM

Machine Learning - Special issue on information retrieval
Real-world Data is Dirty: Data Cleansing and The Merge/Purge Problem

Data Mining and Knowledge Discovery
A Distance-Based Approach to Entity Reconciliation in Heterogeneous Databases

IEEE Transactions on Knowledge and Data Engineering
Record Matching in Data Warehouses: A Decision Model for Data Consolidation

Operations Research
Selectively Acquiring Customer Information: A New Data Acquisition Problem and an Active Learning-Based Solution

Management Science
A Framework for Reconciling Attribute Values from Multiple Data Sources

Management Science

Quantified Score

Hi-index	0.00

Visualization

Abstract

With the growing volume of collected and stored data from customer interactions that have recently shifted towards online channels, an important challenge faced by today's businesses is appropriately dealing with data quality problems. A key step in the data cleaning process is the matching and merging of customer records to assess the identity of individuals. The practical importance of this research is exemplified by a large client firm that deals with private label credit cards. They needed to know whether there existed histories of new customers within the company, in order to decide on the appropriate parameters of possible card offerings. The company incurs substantial costs if they incorrectly ''match'' an incoming application with an existing customer (Type I error), and also if they falsely assume that there is no match (Type II error). While there is a good deal of generic identity matching software available, that will provide a ''strength'' score for each potential match, the question of how to use the scores for new applications is of great interest and is addressed in this work. The academic significance lies in the analysis of the score thresholds that are typically used in decision making. That is, upper and lower thresholds are set, where matches are accepted above the former, rejected below the latter, and more information is gathered between the two. We show, for the first time, that the optimal thresholds can be considered to be parameters of a matching distribution, and a number of estimators of these parameters are developed and analyzed. Then extensive computations show the effects of various factors on the convergence rates of the estimates.